Oct 30 10:44:21.368011 ip-10-0-132-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 10:44:21.788084 ip-10-0-132-202 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:44:21.788084 ip-10-0-132-202 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 10:44:21.788084 ip-10-0-132-202 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:44:21.788084 ip-10-0-132-202 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:44:21.792959 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792878    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.792959 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792958    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.792959 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792963    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792968    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792973    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792978    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792983    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792987    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792991    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792994    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.792998    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793003    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793007    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793011    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793015    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793019    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793024    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793028    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793032    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793036    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793041    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793045    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.793171 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793050    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793054    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793058    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793062    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793067    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793071    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793075    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793080    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793085    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793089    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793105    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793111    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793116    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793121    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793126    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793131    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793136    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793140    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793145    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793150    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.794111 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793154    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793159    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793164    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793168    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793173    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793177    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793181    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793186    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793192    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793196    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793200    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793206    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793211    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793216    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793220    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793227    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793231    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793236    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793240    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793252    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.794974 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793258    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793262    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793267    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793272    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793276    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793281    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793286    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793291    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793296    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793301    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793306    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793313    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793319    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793324    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793329    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793335    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793340    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793345    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793349    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793354    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.795856 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793358    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793365    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793370    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793375    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793379    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793384    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793389    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793393    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793397    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793402    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793407    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793411    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793416    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793421    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793426    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793430    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793435    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793443    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793451    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.796780 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793457    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793462    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793467    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793472    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.793477    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794726    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794737    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794742    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794747    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794752    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794758    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794762    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794767    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794772    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794776    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794782    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794787    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794792    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794796    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.797269 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794801    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794806    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794811    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794815    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794820    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794825    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794830    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794834    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794839    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794843    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794848    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794854    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794859    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794864    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794869    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794873    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794878    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794883    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794887    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794892    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.797778 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794896    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794901    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794906    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794910    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794915    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794919    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794924    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794929    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794933    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794939    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794944    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794949    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794954    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794959    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794963    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794968    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794972    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794976    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794981    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794985    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.798668 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794990    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.794996    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795002    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795008    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795014    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795019    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795024    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795030    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795035    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795039    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795044    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795049    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795053    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795058    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795062    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795067    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795072    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795077    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795082    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795086    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.799570 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795090    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795095    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795101    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795106    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795110    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795115    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795120    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795124    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795129    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795134    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795138    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795143    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795148    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795152    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795159    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795167    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795172    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795176    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.800395 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795181    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795186    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795190    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795195    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795200    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795205    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795209    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795214    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795221    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795225    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795230    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795235    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795239    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.795243    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796070    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796080    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796087    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796092    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796097    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.800863 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796102    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796106    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796136    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796144    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796150    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796155    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796159    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796164    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796169    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796173    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796179    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796184    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796188    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796193    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796198    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796203    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796207    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796212    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796216    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.801526 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796222    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796226    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796231    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796236    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796241    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796245    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796251    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796255    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796259    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796264    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796268    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796274    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796279    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796284    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796289    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796294    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796298    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796303    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796307    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.802015 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796312    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796317    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796322    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796328    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796332    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796340    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796345    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796349    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796354    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796358    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796364    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796368    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796373    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796377    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796382    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796386    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796391    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796395    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796400    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796404    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.802477 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796410    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796414    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796419    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796424    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796431    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796438    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796443    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796448    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796453    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796460    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796466    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796471    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796476    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796481    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796485    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796490    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796495    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796502    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796506    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.803058 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796511    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796516    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796520    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796524    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796529    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796536    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796541    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796547    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796551    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796556    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796561    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796566    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796571    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796575    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796581    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796585    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796590    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796594    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796599    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796604    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.803520 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796609    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796613    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796618    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.796623    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797772    2569 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797795    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797804    2569 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797812    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797819    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797825    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797833    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797840    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797845    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797850    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797856    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797862    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797867    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797873    2569 flags.go:64] FLAG: --cgroup-root=""
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797878    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797884    2569 flags.go:64] FLAG: --client-ca-file=""
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797889    2569 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797893    2569 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797904    2569 flags.go:64] FLAG: --cluster-domain=""
Oct 30 10:44:21.804013 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797910    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797915    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797921    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797927    2569 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797934    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797938    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797944    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797950    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797955    2569 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797961    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797966    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797972    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797977    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797984    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797990    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.797995    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798000    2569 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798005    2569 flags.go:64] FLAG: --enable-server="true"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798011    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798053    2569 flags.go:64] FLAG: --event-burst="100"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798059    2569 flags.go:64] FLAG: --event-qps="50"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798064    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798070    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798076    2569 flags.go:64] FLAG: --eviction-hard=""
Oct 30 10:44:21.804565 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798083    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798089    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798094    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798100    2569 flags.go:64] FLAG: --eviction-soft=""
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798105    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798110    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798115    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798120    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798125    2569 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798130    2569 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798136    2569 flags.go:64] FLAG: --feature-gates=""
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798142    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798148    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798153    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798158    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798164    2569 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798169    2569 flags.go:64] FLAG: --help="false"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798174    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-132-202.ec2.internal"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798181    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798186    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798192    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798198    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798204    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798209    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 10:44:21.805214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798214    2569 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798219    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798224    2569 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798230    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798235    2569 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798240    2569 flags.go:64] FLAG: --kube-reserved=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798245    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798250    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798256    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798261    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798266    2569 flags.go:64] FLAG: --lock-file=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798271    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798277    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798282    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798291    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798296    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798301    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798307    2569 flags.go:64] FLAG: --logging-format="text"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798312    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798318    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798323    2569 flags.go:64] FLAG: --manifest-url=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798327    2569 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798335    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798340    2569 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798347    2569 flags.go:64] FLAG: --max-pods="110"
Oct 30 10:44:21.805902 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798352    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798357    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798367    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798372    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798378    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798383    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798388    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798400    2569 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798405    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798410    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798415    2569 flags.go:64] FLAG: --pod-cidr=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798420    2569 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798425    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798430    2569 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798435    2569 flags.go:64] FLAG: --port="10250"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798440    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798445    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1e117d635a670cf"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798451    2569 flags.go:64] FLAG: --qos-reserved=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798456    2569 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798461    2569 flags.go:64] FLAG: --register-node="true"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798466    2569 flags.go:64] FLAG: --register-with-taints=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798473    2569 flags.go:64] FLAG: --registry-burst="10"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798478    2569 flags.go:64] FLAG: --registry-qps="5"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798483    2569 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798488    2569 flags.go:64] FLAG: --reserved-memory=""
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798494    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 10:44:21.806489 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798500    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798506    2569 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798511    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798516    2569 flags.go:64] FLAG: --runonce="false"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798521    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798527    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798532    2569 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798537    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798542    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798549    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798555    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798560    2569 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798565    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798571    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798576    2569 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798583    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798588    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798593    2569 flags.go:64] FLAG: --system-cgroups=""
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798598    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798607    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798612    2569 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798617    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798624    2569 flags.go:64] FLAG: --tls-min-version=""
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798631    2569 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798636    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 10:44:21.807139 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798641    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798647    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798652    2569 flags.go:64] FLAG: --v="2"
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798659    2569 flags.go:64] FLAG: --version="false"
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798666    2569 flags.go:64] FLAG: --vmodule=""
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798672    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.798677    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798899    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798908    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798914    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798919    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798923    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798929    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798933    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798938    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798943    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798948    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798953    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798958    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798963    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798969    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.807769 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798974    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798981    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798985    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798990    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.798995    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799000    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799004    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799009    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799014    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799021    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799025    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799030    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799035    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799040    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799045    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799049    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799053    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799058    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799062    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799067    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.808280 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799072    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799077    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799082    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799087    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799092    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799096    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799100    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799105    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799110    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799116    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799121    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799126    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799131    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799137    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799141    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799146    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799151    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799155    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799160    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799164    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.808830 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799169    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799176    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799181    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799185    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799190    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799195    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799200    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799205    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799210    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799215    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799219    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799226    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799233    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799238    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799243    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799247    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799252    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799257    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799261    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.809313 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799266    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799271    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799275    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799281    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799286    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799291    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799297    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799301    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799306    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799313    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799319    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799324    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799329    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799334    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799348    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799354    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799358    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799362    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799367    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799372    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.809822 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799377    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799381    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799386    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799391    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799395    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799400    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799404    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799409    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799414    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799418    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799423    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799428    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799432    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.799473    2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799530    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799539    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.810296 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799546    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799551    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799556    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799563    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799567    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799572    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799576    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799581    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799586    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799590    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799596    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799602    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799607    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799612    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799617    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799621    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799626    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799631    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799636    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799640    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.810672 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799645    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799649    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799654    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799659    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799664    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799668    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799673    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799677    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799682    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799686    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799705    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799711    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799716    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799721    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799726    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799733    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799737    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799742    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799747    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799752    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.811159 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799756    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799761    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799770    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799777    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799783    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799789    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799794    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799798    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799803    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799809    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799814    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799819    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799824    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799829    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799834    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799839    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799843    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799848    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799853    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.811638 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799860    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799866    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799870    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799875    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799880    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799884    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799890    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799895    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799901    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799906    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799911    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799915    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799920    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799925    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799930    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799937    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799942    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799946    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799951    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799955    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.812230 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799961    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799965    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799970    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799975    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799980    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799984    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799989    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799994    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.799998    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800003    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800007    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800012    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800017    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800022    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800026    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800031    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800035    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800040    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800045    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.812731 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800050    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800056    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800061    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800066    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800070    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.800075    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.807277    2569 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.807298    2569 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.808101    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.808108    2569 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808165    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808171    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808174    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808177    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808180    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808183    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808186    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808189    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808191    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.813267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808194    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808197    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808199    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808202    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808205    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808207    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808210    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808213    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808215    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808218    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808221    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808224    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808227    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808229    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808232    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808234    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808237    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808240    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808242    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.813837 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808245    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808255    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808259    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808262    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808264    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808267    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808269    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808272    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808275    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808277    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808280    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808282    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808285    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808288    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808292    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808296    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808299    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808302    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808305    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.814276 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808307    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808310    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808313    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808315    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808318    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808320    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808323    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808325    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808328    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808331    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808333    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808336    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808338    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808341    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808344    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808353    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808356    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808358    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808361    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808363    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.814776 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808366    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808369    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808371    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808374    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808376    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808379    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808381    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808384    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808386    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808389    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808391    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808394    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808396    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808399    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808401    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808404    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808406    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808409    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808411    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.815267 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808415    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808420    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808423    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808426    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808429    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808432    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808435    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808439    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808441    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808449    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808453    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808455    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808458    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808461    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808463    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808466    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808468    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808471    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808473    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.815882 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808476    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.808503    2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808680    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808684    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808688    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808690    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808704    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808707    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808710    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808712    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808715    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808718    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808720    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808723    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808727    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808731    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.816368 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808735    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808738    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808741    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808743    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808746    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808749    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808752    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808760    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808763    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808766    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808768    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808771    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808774    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808776    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808779    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808781    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808784    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808786    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808789    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.816798 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808791    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808794    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808796    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808799    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808807    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808810    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808813    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808815    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808818    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808820    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808823    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808825    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808827    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808830    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808833    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808836    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808839    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808842    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808845    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.817552 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808847    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808850    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808859    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808862    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808865    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808867    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808869    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808872    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808875    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808877    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808879    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808882    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808884    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808887    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808889    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808892    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808894    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808897    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808899    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808902    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.818308 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808904    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808907    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808909    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808912    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808914    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808917    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808920    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808922    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808925    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808927    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808930    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808932    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808935    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808937    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808940    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808948    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808950    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808953    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808955    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808958    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.818828 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808961    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808963    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808966    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808968    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808970    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808973    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808975    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808978    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808980    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808983    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808987    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808990    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808993    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.808996    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.809019    2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:44:21.819298 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809056    2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809061    2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809064    2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809067    2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809070    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809072    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809075    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809077    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809080    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809082    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809085    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809087    2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809090    2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809098    2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809101    2569 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809104    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809106    2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809109    2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809111    2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:44:21.819679 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809114    2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809116    2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809118    2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809121    2569 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809124    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809126    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809129    2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809131    2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809134    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809136    2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809139    2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809141    2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809144    2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809146    2569 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809148    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809151    2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809154    2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809156    2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809159    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809161    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:44:21.820219 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809164    2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809167    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809169    2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809172    2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809174    2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809177    2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809179    2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809189    2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809193    2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809195    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809198    2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809201    2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809203    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809207    2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809209    2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809212    2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809214    2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809217    2569 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809219    2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809222    2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:44:21.820740 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809224    2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809227    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809229    2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809233    2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809237    2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809240    2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809242    2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809245    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809247    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809250    2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809252    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809255    2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809258    2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809260    2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809263    2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809265    2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809268    2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809270    2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809273    2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:44:21.821239 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809275    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809283    2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809286    2569 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809289    2569 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809291    2569 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809294    2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809296    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809299    2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809302    2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809304    2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809307    2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809309    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809312    2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809314    2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809317    2569 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809320    2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809322    2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809325    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809328    2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809331    2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:44:21.821838 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809333    2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809335    2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809338    2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809340    2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809344    2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809346    2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809349    2569 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:21.809353    2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.809410    2569 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.811971    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.813034    2569 server.go:1014] "Starting client certificate rotation"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.813183    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.813246    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.815326    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 10:44:21.822457 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.819435    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 10:44:21.836485 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.836466    2569 log.go:25] "Validated CRI v1 runtime API"
Oct 30 10:44:21.840422 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.840410    2569 log.go:25] "Validated CRI v1 image API"
Oct 30 10:44:21.841274 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.841247    2569 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 10:44:21.844057 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.844040    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87d29c75-d268-4d81-8e2c-5f607bb78a28:/dev/nvme0n1p3 e78816f4-23ff-4bb7-91dc-0e51ce0ad7f3:/dev/nvme0n1p4]
Oct 30 10:44:21.844118 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.844057    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 10:44:21.848756 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.848643    2569 manager.go:217] Machine: {Timestamp:2026-10-30 10:44:21.848159624 +0000 UTC m=+0.379597749 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100301 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f9d6fa583f45d1154fe296ff11d88 SystemUUID:ec2f9d6f-a583-f45d-1154-fe296ff11d88 BootID:6474dd9f-ba2b-46f8-97ca-4768272b68a0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e4:84:34:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e4:84:34:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:61:31:64:e7:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 10:44:21.848756 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.848751    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 10:44:21.848858 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.848819    2569 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 10:44:21.852480 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852452    2569 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 10:44:21.852644 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852482    2569 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 10:44:21.852685 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852647    2569 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 10:44:21.852685 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852654    2569 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 10:44:21.852685 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852671    2569 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 10:44:21.852768 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.852686    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 10:44:21.853904 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.853893    2569 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 10:44:21.858563 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.858552    2569 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 10:44:21.858666 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.858657    2569 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 10:44:21.859517 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859508    2569 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 10:44:21.859550 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859521    2569 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 10:44:21.859550 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859531    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 10:44:21.859550 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859539    2569 kubelet.go:405] "Adding apiserver pod source"
Oct 30 10:44:21.859550 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859547    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 10:44:21.859880 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.859869    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 10:44:21.862449 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.862427    2569 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 10:44:21.869903 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.869883    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 10:44:21.870785 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870773    2569 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 10:44:21.870835 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870803    2569 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 10:44:21.870979 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870968    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 10:44:21.871026 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870985    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 10:44:21.871026 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870991    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 10:44:21.871026 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.870997    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 10:44:21.871026 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871003    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 10:44:21.871026 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871013    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 10:44:21.871810 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871801    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 10:44:21.871849 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871812    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 10:44:21.871849 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871820    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 10:44:21.871849 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871826    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 10:44:21.871849 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871834    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 10:44:21.871849 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.871844    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 10:44:21.872731 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.872721    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 10:44:21.872771 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.872735    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 10:44:21.876615 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.876598    2569 server.go:1263] "Started kubelet"
Oct 30 10:44:21.876735 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.876671    2569 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 10:44:21.876786 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.876684    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 10:44:21.876786 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.876771    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 10:44:21.877282 ip-10-0-132-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 10:44:21.878335 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.878322    2569 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 10:44:21.878673 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.878660    2569 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 10:44:21.883239 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.883215    2569 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 10:44:21.886857 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.886841    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 10:44:21.888161 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.888146    2569 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 10:44:21.888518 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.888290    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:21.889011 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.888994    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 10:44:21.889011 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.888995    2569 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889018    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889030    2569 factory.go:55] Registering systemd factory
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889036    2569 factory.go:223] Registration of the systemd container factory successfully
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889022    2569 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889124    2569 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 10:44:21.889134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889137    2569 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 10:44:21.889406 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889229    2569 factory.go:153] Registering CRI-O factory
Oct 30 10:44:21.889406 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889239    2569 factory.go:223] Registration of the crio container factory successfully
Oct 30 10:44:21.889406 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889255    2569 factory.go:103] Registering Raw factory
Oct 30 10:44:21.889406 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.889265    2569 manager.go:1199] Started watching for new ooms in manager
Oct 30 10:44:21.890360 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.890346    2569 manager.go:319] Starting recovery of all containers
Oct 30 10:44:21.899234 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.899213    2569 manager.go:324] Recovery completed
Oct 30 10:44:21.904792 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.904769    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 10:44:21.904908 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.904873    2569 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 10:44:21.905377 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.905362    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:21.905911 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.904774    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18e348bf04976029  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-10-30 10:44:21.876572201 +0000 UTC m=+0.408010325,LastTimestamp:2026-10-30 10:44:21.876572201 +0000 UTC m=+0.408010325,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Oct 30 10:44:21.906919 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.906898    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:21.906975 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.906936    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:21.906975 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.906952    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:21.907505 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.907491    2569 cpu_manager.go:226] "Starting" policy="none"
Oct 30 10:44:21.907505 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.907502    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:21.907617 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.907503    2569 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 10:44:21.907617 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.907540    2569 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 10:44:21.908181 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.908163    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:21.908244 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.908195    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:21.908244 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.908210    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:21.909961 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.909947    2569 policy_none.go:50] "Start"
Oct 30 10:44:21.910032 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.909964    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 10:44:21.910032 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.909977    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 10:44:21.912063 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.912050    2569 policy_none.go:44] "Start"
Oct 30 10:44:21.919616 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.919601    2569 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 10:44:21.919707 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.919659    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qd9s8"
Oct 30 10:44:21.920942 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.920792    2569 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 10:44:21.920942 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.920894    2569 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 10:44:21.924973 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.924954    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qd9s8"
Oct 30 10:44:21.929863 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.929842    2569 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 10:44:21.929863 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.929799    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18e348bf06666def  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-10-30 10:44:21.906918895 +0000 UTC m=+0.438357020,LastTimestamp:2026-10-30 10:44:21.906918895 +0000 UTC m=+0.438357020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Oct 30 10:44:21.940770 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.940743    2569 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 10:44:21.943226 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943095    2569 manager.go:341] "Starting Device Plugin manager"
Oct 30 10:44:21.943287 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.943245    2569 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 10:44:21.943287 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943258    2569 server.go:87] "Starting device plugin registration server"
Oct 30 10:44:21.943521 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943485    2569 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 10:44:21.943521 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943501    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 10:44:21.943667 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943655    2569 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 10:44:21.943757 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943743    2569 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 10:44:21.943757 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:21.943755    2569 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 10:44:21.944240 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.944211    2569 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 10:44:21.944317 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.944259    2569 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:21.945227 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.945166    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18e348bf0666ce27  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-10-30 10:44:21.906943527 +0000 UTC m=+0.438381653,LastTimestamp:2026-10-30 10:44:21.906943527 +0000 UTC m=+0.438381653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:21.996043    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18e348bf066708ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-10-30 10:44:21.906958542 +0000 UTC m=+0.438396668,LastTimestamp:2026-10-30 10:44:21.906958542 +0000 UTC m=+0.438396668,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.030586    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.031776    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.032275    2569 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.032308    2569 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.032355    2569 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.043966    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.044719    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.044748    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.044761    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:22.051751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.044780    2569 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.054635 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.054564    2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-202.ec2.internal.18e348bf06666def\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18e348bf06666def  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-10-30 10:44:21.906918895 +0000 UTC m=+0.438357020,LastTimestamp:2026-10-30 10:44:21.908179373 +0000 UTC m=+0.439617498,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Oct 30 10:44:22.084083 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.084060    2569 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:44:22.093358 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.093341    2569 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.093421 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.093361    2569 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-202.ec2.internal\": node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.132873 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.132841    2569 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"]
Oct 30 10:44:22.132966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.132899    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:22.134275 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.134259    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.134887 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.134873    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:22.134967 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.134903    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:22.134967 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.134917    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:22.137134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.137120    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:22.137273 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.137258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.137321 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.137286    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:22.138626 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138609    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:22.138626 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138622    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:22.138758 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138639    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:22.138758 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138646    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:22.138758 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138661    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:22.138758 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.138649    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:22.140760 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.140745    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.140812 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.140769    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:22.141529 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.141503    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:22.141574 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.141542    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:22.141574 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.141553    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:22.169253 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.169237    2569 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-202.ec2.internal\" not found" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.172508 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.172492    2569 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-202.ec2.internal\" not found" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.235074 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.235060    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.290475 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.290457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.290547 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.290495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.290547 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.290512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.335988 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.335953    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.391122 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.391173 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.391173 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391143    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.391241 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391171    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.391241 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391189    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.391241 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.391206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.436590 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.436569    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.472182 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.472164    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.475119 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.475102    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:22.537094 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.537067    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.637538 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.637495    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.737984 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.737965    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:22.812407 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.812385    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 10:44:22.812766 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:22.812483    2569 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 10:44:22.838630 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:22.838607    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:24.471052 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:24.471030    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:24.565854 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.565820    2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:44:24.566751 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.566731    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:44:24.566869 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.566766    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:44:24.566869 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.566780    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:44:24.572087 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:24.572052    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:24.582826 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:24.582798    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea3b5076a68f9927518ca754f7c3120.slice/crio-e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b WatchSource:0}: Error finding container e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b: Status 404 returned error can't find the container with id e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b
Oct 30 10:44:24.583255 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:24.583232    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe533252ce0dba51bc9516009d3c38bb.slice/crio-4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae WatchSource:0}: Error finding container 4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae: Status 404 returned error can't find the container with id 4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae
Oct 30 10:44:24.586642 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.586618    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 10:39:23 +0000 UTC" deadline="2028-06-15 16:03:47.633222519 +0000 UTC"
Oct 30 10:44:24.586710 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.586644    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14261h19m23.046582746s"
Oct 30 10:44:24.588074 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.588062    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 10:44:24.661628 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.661606    2569 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:44:24.672711 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:24.672692    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:24.773261 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:24.773220    2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:44:24.777901 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.777880    2569 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:44:24.820950 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.820933    2569 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:24.843589 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.843566    2569 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 10:44:24.844802 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.844787    2569 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:44:24.863011 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.862975    2569 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 10:44:24.962407 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:24.962388    2569 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:44:25.392112 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.392083    2569 apiserver.go:52] "Watching apiserver"
Oct 30 10:44:25.395852 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.395828    2569 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:44:25.419962 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.419928    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 10:44:25.426264 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.426239    2569 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 10:44:25.426947 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.426668    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal","openshift-multus/network-metrics-daemon-h9mjb","kube-system/konnectivity-agent-llcdz","openshift-multus/multus-7fqs2","openshift-network-operator/iptables-alerter-qm9wr","kube-system/global-pull-secret-syncer-25rss","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4","openshift-cluster-node-tuning-operator/tuned-fsdk6","openshift-dns/node-resolver-m42hf","openshift-multus/multus-additional-cni-plugins-m8kgs","openshift-image-registry/node-ca-pzbfk","openshift-network-diagnostics/network-check-target-tvvbs","openshift-ovn-kubernetes/ovnkube-node-prv2b"]
Oct 30 10:44:25.429384 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.429362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.429492 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.429445    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:25.431431 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.431408    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:25.431540 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.431511    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:25.433619 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.433598    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.433725 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.433658    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:25.435769 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.435737    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.438053 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.438032    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.440214 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.440184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.442723 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.442415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.444745 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.444728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.448690 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.447535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.448690 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.448277    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 10:44:25.448690 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.448334    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 10:44:25.448690 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.448422    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xt7nj\""
Oct 30 10:44:25.449711 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.449694    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 10:44:25.449868 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.449820    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mhmcf\""
Oct 30 10:44:25.449978 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.449963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.450423 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.450407    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.450515 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.450480    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 10:44:25.450567 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.450524    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.451822 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.451759    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9pzxh\""
Oct 30 10:44:25.451912 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.451876    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.452024 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.452008    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 10:44:25.452121 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.452106    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.452367 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.452333    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.454368 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.453935    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s5t5b\""
Oct 30 10:44:25.454368 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.454215    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.454368 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.454251    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.454826 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.454809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.457816 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.457796    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 10:44:25.458832 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.458813    2569 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 10:44:25.458933 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.458880    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n7vzf"
Oct 30 10:44:25.470579 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.470529    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n7vzf"
Oct 30 10:44:25.521806 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.521788    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 10:44:25.530415 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.530528 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.530528 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.530528 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.530528 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fct6z\" (UniqueName: \"kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29q5f\" (UniqueName: \"kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.530732 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.530991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531056    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.531253 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntt7k\" (UniqueName: \"kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcq6h\" (UniqueName: \"kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531351    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p77wc\" (UniqueName: \"kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.532686 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531471    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d4kc\" (UniqueName: \"kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.533254 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wxm\" (UniqueName: \"kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.531985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmptj\" (UniqueName: \"kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532050    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shzp\" (UniqueName: \"kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.533878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.534474 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.532140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.548600 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548576    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vwt65\""
Oct 30 10:44:25.548701 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548575    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-472bd\""
Oct 30 10:44:25.548701 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548599    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 10:44:25.548701 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548597    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ghh8s\""
Oct 30 10:44:25.548701 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548681    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.548701 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548695    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lntjm\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548747    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548756    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548768    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548791    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548798    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548813    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548815    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548842    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548844    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5fdc6\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548843    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548878    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548882    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 10:44:25.548943 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.548925    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 10:44:25.549434 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.549012    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 10:44:25.569285 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.569246    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerStarted","Data":"e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b"}
Oct 30 10:44:25.570660 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.570636    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"be533252ce0dba51bc9516009d3c38bb","Type":"ContainerStarted","Data":"4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae"}
Oct 30 10:44:25.632790 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.632790 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632808    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.632969 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632937    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632980    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.632983    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633023    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct6z\" (UniqueName: \"kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633057    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633140    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29q5f\" (UniqueName: \"kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633215    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633234    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.633371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633176    2569 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633259    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.634170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.634475 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633784    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.635412 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635384    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.635412 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633617    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633643    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633655    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635462    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633467    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633421    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.633589    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.635573 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635567    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635686    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635738    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635808    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635950    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.636000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.635990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636077    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntt7k\" (UniqueName: \"kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:25.636325 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636454    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.636635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.636878 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.636813    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.637572 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.637549    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.637728 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.637689    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.638279 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638199    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.638279 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.638279 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638226    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.638470 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.638470 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638381    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.638470 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcq6h\" (UniqueName: \"kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.638470 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.638755 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.638821 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.638821 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638793    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.638821 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638807    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638844    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638902    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p77wc\" (UniqueName: \"kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.638966 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.638950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639000    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d4kc\" (UniqueName: \"kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639156    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.639173    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:25.639255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639254    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.639262    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:26.139241647 +0000 UTC m=+3.139034079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639389    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639576    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639664    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.639729 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639693    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639733    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639848    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639947    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.639969    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wxm\" (UniqueName: \"kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640024    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640133    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.640170 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640208    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640224    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640240    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640276    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640308    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640483    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640574    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.640585    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640630    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.640640    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:26.14062553 +0000 UTC m=+3.140417958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640713    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640748    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.641002 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.640960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmptj\" (UniqueName: \"kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641632    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.641734 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.641690    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.642083 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642065    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.642180 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.642180 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.642317 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.642317 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.642583 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.642563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shzp\" (UniqueName: \"kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.645205 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.645156    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.645205 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.645198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.682610 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.682572    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:25.682610 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.682601    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:25.682610 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.682616    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:25.682828 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:25.682670    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:26.182652599 +0000 UTC m=+3.182445032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:25.683322 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.683301    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29q5f\" (UniqueName: \"kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.684012 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.683943    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmptj\" (UniqueName: \"kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.684515 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.684490    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wxm\" (UniqueName: \"kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.685715 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.685693    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d4kc\" (UniqueName: \"kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:25.686737 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.686711    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p77wc\" (UniqueName: \"kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.687216 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.687188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcq6h\" (UniqueName: \"kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.687597 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.687575    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntt7k\" (UniqueName: \"kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.687677 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.687618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shzp\" (UniqueName: \"kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.689797 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.689612    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct6z\" (UniqueName: \"kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.754255 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.754224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:25.762106 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.762087    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7fqs2"
Oct 30 10:44:25.766208 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.766181    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e60f44_aa7a_4f52_b343_cfd031e269a7.slice/crio-2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804 WatchSource:0}: Error finding container 2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804: Status 404 returned error can't find the container with id 2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804
Oct 30 10:44:25.772595 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.772576    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:44:25.776163 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.776136    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10894a7_4b13_4fd3_8a3d_74199059fd53.slice/crio-4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88 WatchSource:0}: Error finding container 4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88: Status 404 returned error can't find the container with id 4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88
Oct 30 10:44:25.777437 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.777250    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:44:25.782696 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.782663    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa94cb8_701b_4ca0_acb2_a013b8f85213.slice/crio-997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183 WatchSource:0}: Error finding container 997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183: Status 404 returned error can't find the container with id 997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183
Oct 30 10:44:25.789528 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.789506    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98178842_8ce7_47da_9867_7315ab84bbe6.slice/crio-93660a221749cdfe813250f12a3c19467b057c56d2002bb084706be2786c99d7 WatchSource:0}: Error finding container 93660a221749cdfe813250f12a3c19467b057c56d2002bb084706be2786c99d7: Status 404 returned error can't find the container with id 93660a221749cdfe813250f12a3c19467b057c56d2002bb084706be2786c99d7
Oct 30 10:44:25.805948 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.805929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:44:25.808303 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.808251    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:44:25.809605 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.809584    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:25.820141 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.820124    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:44:25.823166 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.823144    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e63fa6_26d3_4247_96ff_15abbb584b6a.slice/crio-1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c WatchSource:0}: Error finding container 1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c: Status 404 returned error can't find the container with id 1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c
Oct 30 10:44:25.825402 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.825378    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b95c22c_bc52_4b87_bdca_0da8ad7b0b79.slice/crio-8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629 WatchSource:0}: Error finding container 8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629: Status 404 returned error can't find the container with id 8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629
Oct 30 10:44:25.826151 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:25.826132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:44:25.829398 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.828692    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c3ae5c_be13_4495_88f8_7641798932b1.slice/crio-119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6 WatchSource:0}: Error finding container 119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6: Status 404 returned error can't find the container with id 119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6
Oct 30 10:44:25.832126 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.832096    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eabd736_4d90_410f_bc80_ff82deb9f1d4.slice/crio-6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec WatchSource:0}: Error finding container 6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec: Status 404 returned error can't find the container with id 6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec
Oct 30 10:44:25.837129 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:25.837108    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f1b53e_4413_4ccf_a089_5eea6f3451af.slice/crio-fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67 WatchSource:0}: Error finding container fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67: Status 404 returned error can't find the container with id fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67
Oct 30 10:44:26.146134 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.145939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:26.146220 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.146162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:26.146220 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.146097    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:26.146311 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.146257    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:27.146236383 +0000 UTC m=+4.146028801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:26.146311 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.146268    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:26.146432 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.146320    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:27.146303912 +0000 UTC m=+4.146096326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:26.247631 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.246997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:26.247631 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.247198    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:26.247631 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.247217    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:26.247631 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.247229    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:26.247631 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:26.247282    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:27.24726515 +0000 UTC m=+4.247057563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:26.474892 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.474641    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 10:39:25 +0000 UTC" deadline="2028-07-15 10:21:15.708370378 +0000 UTC"
Oct 30 10:44:26.474892 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.474769    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14975h36m49.23360589s"
Oct 30 10:44:26.585768 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.585733    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerStarted","Data":"fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67"}
Oct 30 10:44:26.601601 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.601570    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4" event={"ID":"44c3ae5c-be13-4495-88f8-7641798932b1","Type":"ContainerStarted","Data":"119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6"}
Oct 30 10:44:26.603639 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.603613    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629"}
Oct 30 10:44:26.616696 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.616627    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m42hf" event={"ID":"76e63fa6-26d3-4247-96ff-15abbb584b6a","Type":"ContainerStarted","Data":"1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c"}
Oct 30 10:44:26.624012 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.623937    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsdk6" event={"ID":"98178842-8ce7-47da-9867-7315ab84bbe6","Type":"ContainerStarted","Data":"93660a221749cdfe813250f12a3c19467b057c56d2002bb084706be2786c99d7"}
Oct 30 10:44:26.627671 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.627603    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7fqs2" event={"ID":"b10894a7-4b13-4fd3-8a3d-74199059fd53","Type":"ContainerStarted","Data":"4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88"}
Oct 30 10:44:26.645000 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.644956    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pzbfk" event={"ID":"0eabd736-4d90-410f-bc80-ff82deb9f1d4","Type":"ContainerStarted","Data":"6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec"}
Oct 30 10:44:26.650151 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.650085    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qm9wr" event={"ID":"ffa94cb8-701b-4ca0-acb2-a013b8f85213","Type":"ContainerStarted","Data":"997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183"}
Oct 30 10:44:26.654519 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.654467    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llcdz" event={"ID":"b0e60f44-aa7a-4f52-b343-cfd031e269a7","Type":"ContainerStarted","Data":"2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804"}
Oct 30 10:44:26.659630 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.659602    2569 generic.go:356] "Generic (PLEG): container finished" podID="dea3b5076a68f9927518ca754f7c3120" containerID="f3ec83ae7bc452a0406859d86a8144218d925a2612971b4485097ac9013b1efa" exitCode=0
Oct 30 10:44:26.659754 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.659685    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerDied","Data":"f3ec83ae7bc452a0406859d86a8144218d925a2612971b4485097ac9013b1efa"}
Oct 30 10:44:26.670944 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:26.670910    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"be533252ce0dba51bc9516009d3c38bb","Type":"ContainerStarted","Data":"0d3abe3ffe4979cb57218d5a48ee83442f6127b9c72ef3d75f23742371c5c9b9"}
Oct 30 10:44:27.156664 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.156583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:27.156664 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.156639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:27.156887 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.156771    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:27.156887 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.156825    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:29.156808705 +0000 UTC m=+6.156601136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:27.157223 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.157204    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:27.157314 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.157248    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:29.157238131 +0000 UTC m=+6.157030556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:27.258525 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.257905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:27.258525 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.258093    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:27.258525 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.258115    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:27.258525 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.258128    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:27.258525 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.258180    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:29.258163594 +0000 UTC m=+6.257956042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:27.475149 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.475038    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 10:39:25 +0000 UTC" deadline="2028-05-06 08:22:14.668448793 +0000 UTC"
Oct 30 10:44:27.475149 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.475072    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13293h37m47.193381111s"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.566850    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.566971    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.567388    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.567491    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.567555    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:27.567670 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:27.567621    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:27.706518 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.706434    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerStarted","Data":"66dfb10eaf093fbbd669cb871279271d5b14946539c89e4646329495093c07d1"}
Oct 30 10:44:27.740893 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.740788    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" podStartSLOduration=3.74077003 podStartE2EDuration="3.74077003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:26.727893736 +0000 UTC m=+3.727686171" watchObservedRunningTime="2026-10-30 10:44:27.74077003 +0000 UTC m=+4.740562467"
Oct 30 10:44:27.741037 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:27.740887    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" podStartSLOduration=3.74088127 podStartE2EDuration="3.74088127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:27.740318567 +0000 UTC m=+4.740111005" watchObservedRunningTime="2026-10-30 10:44:27.74088127 +0000 UTC m=+4.740673708"
Oct 30 10:44:28.713602 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:28.711972    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="33de8c8f409ac9eabfb7577444160498d8950a78d8b461a3a9197de669d41952" exitCode=0
Oct 30 10:44:28.713602 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:28.713233    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"33de8c8f409ac9eabfb7577444160498d8950a78d8b461a3a9197de669d41952"}
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.173003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.173104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.173238    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.173295    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:33.173277764 +0000 UTC m=+10.173070190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.173714    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:29.173844 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.173767    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:33.173751869 +0000 UTC m=+10.173544305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:29.273647 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.273570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:29.273812 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.273752    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:29.273812 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.273775    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:29.273812 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.273786    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:29.273981 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.273845    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:33.273827836 +0000 UTC m=+10.273620267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.565070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.565224    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.567848    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.567965    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.568059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:29.568386 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:29.568144    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:29.732854 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.732161    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llcdz" event={"ID":"b0e60f44-aa7a-4f52-b343-cfd031e269a7","Type":"ContainerStarted","Data":"1e9e48cbe5ffe6db55e77e6b65b86181e73192a1cd86a4b492ef6b076c371c30"}
Oct 30 10:44:29.767166 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:29.766486    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-llcdz" podStartSLOduration=3.062989206 podStartE2EDuration="6.766467064s" totalImagesPullingTime="3.703477858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:29.765880708 +0000 UTC m=+6.765673156" watchObservedRunningTime="2026-10-30 10:44:29.766467064 +0000 UTC m=+6.766259502"
Oct 30 10:44:31.566635 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.566606    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:31.567026 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:31.566739    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:31.567421 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.567115    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:31.567421 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:31.567228    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:31.567421 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.567276    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:31.567421 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:31.567360    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:31.581281 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.581262    2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:31.583808 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.581705    2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:31.743257 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.743183    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4" event={"ID":"44c3ae5c-be13-4495-88f8-7641798932b1","Type":"ContainerStarted","Data":"ee4f31cf78f047fbe94c46365fd35db2d9a4f50bbc570fe1971b5c547dfb5ed8"}
Oct 30 10:44:31.760367 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.760278    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pzbfk" event={"ID":"0eabd736-4d90-410f-bc80-ff82deb9f1d4","Type":"ContainerStarted","Data":"3ca22f8394a50baaa4267cdd3d89d63646dc709a76b5ccc02740a34a1f9ffc13"}
Oct 30 10:44:31.761038 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.760901    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:31.761371 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.761317    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:44:31.829197 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:31.828263    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pzbfk" podStartSLOduration=3.9665578889999997 podStartE2EDuration="8.828244064s" totalImagesPullingTime="4.861686175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:31.794033676 +0000 UTC m=+8.793826113" watchObservedRunningTime="2026-10-30 10:44:31.828244064 +0000 UTC m=+8.828036500"
Oct 30 10:44:33.003832 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.003794    2569 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.205946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.206003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.206127    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.206182    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:41.206164447 +0000 UTC m=+18.205956878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.206582    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:33.206671 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.206635    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:41.206623931 +0000 UTC m=+18.206416344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:33.307075 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.307038    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:33.307250 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.307210    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:33.307250 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.307235    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:33.307250 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.307248    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:33.307432 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.307308    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:41.307289678 +0000 UTC m=+18.307082113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:33.481258 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.480538    2569 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T10:44:33.003815469Z","UUID":"65ed61e5-b19a-452a-9bea-8a897b5f11f1","Handler":null,"Name":"","Endpoint":""}
Oct 30 10:44:33.483077 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.483044    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 10:44:33.483196 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.483087    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.565605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.565698    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.565719    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.565780    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.565826    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:33.566036 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:33.565886    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:33.766809 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.766573    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="f7135a132eab508d4195baba3f46548a18168db5608a6d1a0b91a0ec7c5f728f" exitCode=0
Oct 30 10:44:33.766945 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.766861    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"f7135a132eab508d4195baba3f46548a18168db5608a6d1a0b91a0ec7c5f728f"}
Oct 30 10:44:33.771795 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.771768    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4" event={"ID":"44c3ae5c-be13-4495-88f8-7641798932b1","Type":"ContainerStarted","Data":"036535ddfa66b829ee975af42f11b78437cc81618c77633012a9667cbf114bbd"}
Oct 30 10:44:33.774237 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.774214    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7fqs2" event={"ID":"b10894a7-4b13-4fd3-8a3d-74199059fd53","Type":"ContainerStarted","Data":"7303ceef6858632d7bf78d63835617d6fee997ffe13cdaf8799c6a223ba38b92"}
Oct 30 10:44:33.856358 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:33.855725    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-7fqs2" podStartSLOduration=3.313344417 podStartE2EDuration="10.855708234s" totalImagesPullingTime="7.542363817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:33.85481823 +0000 UTC m=+10.854610667" watchObservedRunningTime="2026-10-30 10:44:33.855708234 +0000 UTC m=+10.855500672"
Oct 30 10:44:34.778035 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.777957    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m42hf" event={"ID":"76e63fa6-26d3-4247-96ff-15abbb584b6a","Type":"ContainerStarted","Data":"ee9f46082b47abbb6f71317c1cba565736251fdfe8b16208ef93a693db5cd0f6"}
Oct 30 10:44:34.780718 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.780692    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qm9wr" event={"ID":"ffa94cb8-701b-4ca0-acb2-a013b8f85213","Type":"ContainerStarted","Data":"0f644f0d00a1e29e37137722c80a36476a9fcb1d231d9560b79eb12cd4a2fcd4"}
Oct 30 10:44:34.783282 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.783251    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="47b6b8007b41f4247647d193e0c89df2809a97cf223e888656c9be02e06ba544" exitCode=0
Oct 30 10:44:34.783382 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.783316    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"47b6b8007b41f4247647d193e0c89df2809a97cf223e888656c9be02e06ba544"}
Oct 30 10:44:34.787469 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.787448    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4" event={"ID":"44c3ae5c-be13-4495-88f8-7641798932b1","Type":"ContainerStarted","Data":"1664ba39322f15627d0b75595b569b83bef26143a1c66ebdb74e2986a62fec0a"}
Oct 30 10:44:34.817212 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.817161    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-m42hf" podStartSLOduration=4.049962496 podStartE2EDuration="11.81714509s" totalImagesPullingTime="7.767182594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:34.816609229 +0000 UTC m=+11.816401664" watchObservedRunningTime="2026-10-30 10:44:34.81714509 +0000 UTC m=+11.816937526"
Oct 30 10:44:34.852944 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.852896    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4" podStartSLOduration=4.021904553 podStartE2EDuration="11.852884568s" totalImagesPullingTime="7.830980015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:34.852408922 +0000 UTC m=+11.852201358" watchObservedRunningTime="2026-10-30 10:44:34.852884568 +0000 UTC m=+11.852677002"
Oct 30 10:44:34.926492 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:34.926443    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qm9wr" podStartSLOduration=4.598659008 podStartE2EDuration="11.92642976s" totalImagesPullingTime="7.327770752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:34.885839443 +0000 UTC m=+11.885631878" watchObservedRunningTime="2026-10-30 10:44:34.92642976 +0000 UTC m=+11.926222195"
Oct 30 10:44:35.564485 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:35.564453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:35.564668 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:35.564569    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:35.564727 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:35.564575    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:35.565499 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:35.565464    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:35.565604 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:35.565534    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:35.565798 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:35.565770    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:36.794641 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:36.794602    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="5745022dba777218e4e724bf5bea16e3f36256467e64bbf0dfa9428d6b4e94c2" exitCode=0
Oct 30 10:44:36.795515 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:36.794689    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"5745022dba777218e4e724bf5bea16e3f36256467e64bbf0dfa9428d6b4e94c2"}
Oct 30 10:44:36.796274 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:36.796246    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsdk6" event={"ID":"98178842-8ce7-47da-9867-7315ab84bbe6","Type":"ContainerStarted","Data":"5159896ce5511d40aeb305cc525b74344ec80c6d5cec0760a450bb2fa54713ab"}
Oct 30 10:44:37.564597 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:37.564355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:37.564791 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:37.564358    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:37.564791 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:37.564404    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:37.564791 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:37.564716    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:37.565032 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:37.564837    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:37.565032 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:37.564898    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:38.804290 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:38.804210    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="f45c3af81f42e59b791340d477161ce1e06624b602f42e52eaf18e93fddcf685" exitCode=0
Oct 30 10:44:38.804290 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:38.804270    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"f45c3af81f42e59b791340d477161ce1e06624b602f42e52eaf18e93fddcf685"}
Oct 30 10:44:38.864324 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:38.864280    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fsdk6" podStartSLOduration=5.956994576 podStartE2EDuration="15.864267235s" totalImagesPullingTime="9.907272659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:36.880130645 +0000 UTC m=+13.879923080" watchObservedRunningTime="2026-10-30 10:44:38.864267235 +0000 UTC m=+15.864059670"
Oct 30 10:44:39.564913 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:39.564884    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:39.564913 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:39.564901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:39.565115 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:39.565004    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:39.565115 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:39.565053    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:39.565219 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:39.565124    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:39.565271 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:39.565228    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:39.809196 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:39.809169    2569 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="d2f44fb7b7fc5e81d0aca83e7a58166f4b24ebc5b755598c8ec3dd1f8069b4a4" exitCode=0
Oct 30 10:44:39.809586 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:39.809209    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerDied","Data":"d2f44fb7b7fc5e81d0aca83e7a58166f4b24ebc5b755598c8ec3dd1f8069b4a4"}
Oct 30 10:44:40.814564 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.814323    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" event={"ID":"32f1b53e-4413-4ccf-a089-5eea6f3451af","Type":"ContainerStarted","Data":"8c0deddba1a979840e06692d8fc10556a79234805f68248ffb3d507858ac0259"}
Oct 30 10:44:40.817274 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817254    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"9a248ca8e4f67743c119e61b38c91f928443e51d57a31022851a38a68fefe48d"}
Oct 30 10:44:40.817383 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817309    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"30c225c70109d18ca8d24df08de3b74b4c3776d02766389cba1b3384721c9148"}
Oct 30 10:44:40.817383 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817358    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"42e3ec52ed504ec2d25c2ea40dda99f38cda2208233ef448ea099271cf9ffcc8"}
Oct 30 10:44:40.817443 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817388    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"769fcc7d6c37f9577ef85ab97e113714ab3df3b0d8771e5041da92d6d054b634"}
Oct 30 10:44:40.817443 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817422    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"dacb51da1941aea1de31f3ac00215702681c48ec64e6b4d287c0f5c983905aa8"}
Oct 30 10:44:40.817529 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.817449    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"c541345904365a831ad9fedc8eecadc26229970d0a758e92ee4a25f0e5dc0325"}
Oct 30 10:44:40.854531 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:40.854492    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m8kgs" podStartSLOduration=7.750774421 podStartE2EDuration="17.854482173s" totalImagesPullingTime="10.103707752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:40.854153393 +0000 UTC m=+17.853945829" watchObservedRunningTime="2026-10-30 10:44:40.854482173 +0000 UTC m=+17.854274607"
Oct 30 10:44:41.261161 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.261130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:41.261277 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.261170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:41.261277 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.261262    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:41.261277 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.261263    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:41.261418 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.261303    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:44:57.261292138 +0000 UTC m=+34.261084550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 10:44:41.261418 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.261315    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret podName:b60d4b1b-34df-469b-aa6b-502402acc947 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:57.26130965 +0000 UTC m=+34.261102062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret") pod "global-pull-secret-syncer-25rss" (UID: "b60d4b1b-34df-469b-aa6b-502402acc947") : object "kube-system"/"original-pull-secret" not registered
Oct 30 10:44:41.361509 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.361487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:41.361642 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.361608    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 10:44:41.361642 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.361627    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 10:44:41.361642 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.361638    2569 projected.go:196] Error preparing data for projected volume kube-api-access-vp4xp for pod openshift-network-diagnostics/network-check-target-tvvbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:41.361798 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.361688    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp podName:5594bd53-9510-41ba-831f-1835fd1b343f nodeName:}" failed. No retries permitted until 2026-10-30 10:44:57.361671314 +0000 UTC m=+34.361463742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp4xp" (UniqueName: "kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp") pod "network-check-target-tvvbs" (UID: "5594bd53-9510-41ba-831f-1835fd1b343f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 10:44:41.565182 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.565126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:41.565293 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.565237    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:41.565293 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:41.565247    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:41.565293 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.565238    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:41.565462 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.565315    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:41.565462 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:41.565408    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:42.824609 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:42.824579    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"2f9d1ed98d454207d7a9cf5e297ed5294349f61c1634b44d0d8abcd0d43c958e"}
Oct 30 10:44:43.564816 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:43.564786    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:43.564985 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:43.564861    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:43.564985 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:43.564901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:43.564985 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:43.564941    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:43.564985 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:43.564973    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:43.565184 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:43.565021    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:44.832582 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.832551    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" event={"ID":"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79","Type":"ContainerStarted","Data":"c01b55844ecc9f21bcb0648c1728e6866779affa5456ae4c2878d297f1f32bd7"}
Oct 30 10:44:44.833032 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.832913    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:44.833032 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.832988    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:44.833032 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.833031    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:44.847811 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.847676    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:44.847920 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.847904    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:44:44.935664 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:44.935609    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b" podStartSLOduration=7.465880769 podStartE2EDuration="21.935596381s" totalImagesPullingTime="14.469715612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:44.935188492 +0000 UTC m=+21.934980928" watchObservedRunningTime="2026-10-30 10:44:44.935596381 +0000 UTC m=+21.935388849"
Oct 30 10:44:45.564932 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:45.564899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:45.565112 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:45.564960    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:45.565112 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:45.564958    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:45.565112 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:45.565052    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:45.565237 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:45.565121    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:45.565237 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:45.565203    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:46.740810 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.740736    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25rss"]
Oct 30 10:44:46.741199 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.740830    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:46.741199 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:46.740940    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:46.743680 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.743653    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvvbs"]
Oct 30 10:44:46.743799 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.743749    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:46.743857 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:46.743833    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:46.750389 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.750363    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9mjb"]
Oct 30 10:44:46.750486 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:46.750453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:46.750540 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:46.750525    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:48.564289 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:48.564260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:48.564785 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:48.564335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:48.564785 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:48.564428    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:48.564785 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:48.564427    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:48.564785 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:48.564514    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:48.564785 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:48.564623    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:50.564614 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:50.564583    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:50.564614 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:50.564611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:50.565123 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:50.564583    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:50.565123 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:50.564676    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:50.565123 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:50.564763    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:50.565123 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:50.564813    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:52.564323 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:52.564281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:52.564323 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:52.564281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:52.564789 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:52.564414    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9mjb" podUID="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e"
Oct 30 10:44:52.564789 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:52.564496    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:52.564789 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:52.564488    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rss" podUID="b60d4b1b-34df-469b-aa6b-502402acc947"
Oct 30 10:44:52.564789 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:52.564548    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvbs" podUID="5594bd53-9510-41ba-831f-1835fd1b343f"
Oct 30 10:44:53.832236 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.832184    2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeReady"
Oct 30 10:44:53.832554 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.832278    2569 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 10:44:53.887493 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.887471    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mk6zq"]
Oct 30 10:44:53.912626 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.912606    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sn9kw"]
Oct 30 10:44:53.912759 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.912739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:53.924981 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.924961    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 10:44:53.925109 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.925082    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-r88l6\""
Oct 30 10:44:53.925109 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.925082    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 10:44:53.925190 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.925149    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 10:44:53.927188 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.927170    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mk6zq"]
Oct 30 10:44:53.927274 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.927203    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sn9kw"]
Oct 30 10:44:53.927328 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.927293    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:53.938982 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.938967    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 10:44:53.939095 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.939082    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 10:44:53.939307 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:53.939297    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgw7c\""
Oct 30 10:44:54.065602 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48fnp\" (UniqueName: \"kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.065602 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.065752 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.065752 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2vt\" (UniqueName: \"kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.065826 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.065826 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.065810    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.166384 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48fnp\" (UniqueName: \"kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.166384 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.166549 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.166585 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2vt\" (UniqueName: \"kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.166625 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.166679 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166613    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.166727 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.166679    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.166727 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:54.166684    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:44:54.166815 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:54.166780    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:44:54.666729774 +0000 UTC m=+31.666551302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:44:54.167151 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.167132    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.170215 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.170198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.186933 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.186908    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48fnp\" (UniqueName: \"kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.187008 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.186946    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2vt\" (UniqueName: \"kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.232531 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.232511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:44:54.548895 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.548802    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mk6zq"]
Oct 30 10:44:54.552352 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:54.552315    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09c17dd_ed06_461b_9cdc_d2ad16557bbc.slice/crio-2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415 WatchSource:0}: Error finding container 2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415: Status 404 returned error can't find the container with id 2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415
Oct 30 10:44:54.564993 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.564972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:54.565087 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.565001    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:54.565142 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.565120    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:54.577090 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.577068    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 10:44:54.577200 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.577147    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 10:44:54.577317 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.577265    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 10:44:54.577858 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.577839    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c9pg5\""
Oct 30 10:44:54.577933 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.577880    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-55bss\""
Oct 30 10:44:54.586801 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.586782    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-vmnnx\""
Oct 30 10:44:54.586895 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.586867    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 10:44:54.669087 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.669067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:54.669185 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:54.669173    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:44:54.669231 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:54.669216    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:44:55.669203513 +0000 UTC m=+32.668995925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:44:54.865808 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:54.865754    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mk6zq" event={"ID":"e09c17dd-ed06-461b-9cdc-d2ad16557bbc","Type":"ContainerStarted","Data":"2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415"}
Oct 30 10:44:55.676895 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:55.676857    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:55.677068 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:55.677017    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:44:55.677133 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:55.677094    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:44:57.677076035 +0000 UTC m=+34.676868448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:44:57.289755 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.289155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:44:57.289755 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.289256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:57.290490 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:57.290424    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 10:44:57.290588 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:57.290494    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:45:29.290477125 +0000 UTC m=+66.290269539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : secret "metrics-daemon-secret" not found
Oct 30 10:44:57.292288 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.292270    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:57.352687 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.352666    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:44:57.390035 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.390016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:57.392370 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.392337    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:57.611717 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.611657    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:44:57.679149 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.679118    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25rss"]
Oct 30 10:44:57.691384 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.691358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:44:57.691468 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:57.691438    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:44:57.691504 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:57.691487    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:45:01.69147241 +0000 UTC m=+38.691264831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:44:57.874570 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.874488    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mk6zq" event={"ID":"e09c17dd-ed06-461b-9cdc-d2ad16557bbc","Type":"ContainerStarted","Data":"8682f697d6abdd66d0b85ccc525fed7d7bd1a6680b5a9773499776acd342e59d"}
Oct 30 10:44:57.875586 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.875566    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25rss" event={"ID":"b60d4b1b-34df-469b-aa6b-502402acc947","Type":"ContainerStarted","Data":"56a7bf6c141e8f90b96782077d4b027795a38471d0ecb2dd0eb0df35c61d50c6"}
Oct 30 10:44:57.909825 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.909742    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mk6zq" podStartSLOduration=2.425055624 podStartE2EDuration="4.909727799s" totalImagesPullingTime="2.484672175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:44:57.908982179 +0000 UTC m=+34.908774614" watchObservedRunningTime="2026-10-30 10:44:57.909727799 +0000 UTC m=+34.909520234"
Oct 30 10:44:57.925464 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:57.925434    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvvbs"]
Oct 30 10:44:57.930272 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:57.930252    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5594bd53_9510_41ba_831f_1835fd1b343f.slice/crio-d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30 WatchSource:0}: Error finding container d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30: Status 404 returned error can't find the container with id d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30
Oct 30 10:44:58.516894 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.516860    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dpvzb"]
Oct 30 10:44:58.536071 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.536042    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.541568 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.541502    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpvzb"]
Oct 30 10:44:58.575789 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.575001    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:44:58.595806 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.595773    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:44:58.595912 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.595876    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.612818 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.612796    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 10:44:58.612941 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.612849    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 10:44:58.612941 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.612867    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 10:44:58.613044 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.612975    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 10:44:58.627679 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.627652    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 10:44:58.632534 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.632500    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 10:44:58.632698 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.632663    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wj9xd\""
Oct 30 10:44:58.632812 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.632716    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sssm5\""
Oct 30 10:44:58.699115 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fvh7\" (UniqueName: \"kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.699258 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.699258 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.699258 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.699258 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.699448 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.699448 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.699448 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.699448 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.699413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800660 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800660 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800640    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:58.800712    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvh7\" (UniqueName: \"kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:58.800790    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:59.300769913 +0000 UTC m=+36.300562345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : configmap "kube-rbac-proxy" not found
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.800866 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.801271 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.800910    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.801271 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.801191    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.801396 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:58.801279    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:44:58.801396 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:58.801317    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:44:59.301303628 +0000 UTC m=+36.301096041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:44:58.801588 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.801570    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.801789 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.801771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.801862 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.801804    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.802117 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.802097    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.822527 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.822478    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvh7\" (UniqueName: \"kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:58.822627 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.822579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:58.879781 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.879743    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvvbs" event={"ID":"5594bd53-9510-41ba-831f-1835fd1b343f","Type":"ContainerStarted","Data":"d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30"}
Oct 30 10:44:58.921794 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:58.921763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:44:59.122193 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.122123    2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wkdk9"]
Oct 30 10:44:59.148472 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.148448    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wkdk9"]
Oct 30 10:44:59.148619 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.148572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.161312 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.161291    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 10:44:59.163896 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.163878    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 10:44:59.164625 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.164433    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 10:44:59.164625 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.164597    2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mnv22\""
Oct 30 10:44:59.253510 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.253445    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:44:59.258181 ip-10-0-132-202 kubenswrapper[2569]: W1030 10:44:59.258150    2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374b9fb3_2f09_480d_8524_d33ea5e0a447.slice/crio-bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871 WatchSource:0}: Error finding container bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871: Status 404 returned error can't find the container with id bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871
Oct 30 10:44:59.262988 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.261550    2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 10:44:59.304794 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.304766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcpgt\" (UniqueName: \"kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.304875 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.304815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:59.304875 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.304836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.305039 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:59.304900    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 10:44:59.305039 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.304924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:44:59.305039 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.304963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.305039 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:59.304983    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:00.304959967 +0000 UTC m=+37.304752383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : configmap "kube-rbac-proxy" not found
Oct 30 10:44:59.305039 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:59.305016    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:44:59.305277 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:44:59.305063    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:00.305047761 +0000 UTC m=+37.304840188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:44:59.406023 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.405961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcpgt\" (UniqueName: \"kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.406023 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.406012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.406195 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.406063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.406836 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.406810    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.408653 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.408629    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.429810 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.429789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcpgt\" (UniqueName: \"kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.477897 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.477872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:44:59.809043 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.809012    2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wkdk9"]
Oct 30 10:44:59.884466 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.884428    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9" event={"ID":"4018b54d-5430-4001-83da-47203f44ff0f","Type":"ContainerStarted","Data":"146cc7b1dd83bf8fc41a63f863a118c9e35228991586e8ad13f294c533f54e77"}
Oct 30 10:44:59.886239 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:44:59.886214    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" event={"ID":"374b9fb3-2f09-480d-8524-d33ea5e0a447","Type":"ContainerStarted","Data":"bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871"}
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:00.314731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:00.314787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:00.314953    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:00.315016    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:02.314998199 +0000 UTC m=+39.314790627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:00.315353    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 10:45:00.315439 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:00.315394    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:02.315382126 +0000 UTC m=+39.315174540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : configmap "kube-rbac-proxy" not found
Oct 30 10:45:01.729241 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:01.729202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:01.729710 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:01.729399    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:45:01.729710 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:01.729475    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:45:09.729454954 +0000 UTC m=+46.729247370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:45:02.332813 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.332771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:02.332971 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.332844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:02.333016 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:02.333003    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:02.333084 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:02.333066    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:06.333048814 +0000 UTC m=+43.332841243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:02.333493 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:02.333459    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 10:45:02.333623 ip-10-0-132-202 kubenswrapper[2569]: E1030 10:45:02.333515    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:06.333500617 +0000 UTC m=+43.333293035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : configmap "kube-rbac-proxy" not found
Oct 30 10:45:02.895499 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.895470    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9" event={"ID":"4018b54d-5430-4001-83da-47203f44ff0f","Type":"ContainerStarted","Data":"0ddc776d34554483bcdd8145532651ece5d9f3098cb60fedcefb7ef6cba59be6"}
Oct 30 10:45:02.897018 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.896991    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" event={"ID":"374b9fb3-2f09-480d-8524-d33ea5e0a447","Type":"ContainerStarted","Data":"bb8648631237bc10664ad409f36ca9e6d4e05641f58474d2e2754a8ddc9f85de"}
Oct 30 10:45:02.898458 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.898438    2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvvbs" event={"ID":"5594bd53-9510-41ba-831f-1835fd1b343f","Type":"ContainerStarted","Data":"6d4f6e7a9697bb01d1e6f2fcf8e8e8f1e98e6a5b4023c1f6c1791d2770057a32"}
Oct 30 10:45:02.898587 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.898572    2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:45:02.930810 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.930520    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9" podStartSLOduration=0.992590089 podStartE2EDuration="3.930504788s" totalImagesPullingTime="2.937914699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:02.929836798 +0000 UTC m=+39.929629233" watchObservedRunningTime="2026-10-30 10:45:02.930504788 +0000 UTC m=+39.930297223"
Oct 30 10:45:02.964077 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.964041    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tvvbs" podStartSLOduration=35.759608169 podStartE2EDuration="39.964029027s" totalImagesPullingTime="4.204420858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:02.963138898 +0000 UTC m=+39.962931334" watchObservedRunningTime="2026-10-30 10:45:02.964029027 +0000 UTC m=+39.963821463"
Oct 30 10:45:02.997092 ip-10-0-132-202 kubenswrapper[2569]: I1030 10:45:02.997059    2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" podStartSLOduration=2.114729188 podStartE2EDuration="4.997048724s" totalImagesPullingTime="2.882319536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:02.996867153 +0000 UTC m=+39.996659589" watchObservedRunningTime="2026-10-30 10:45:02.997048724 +0000 UTC m=+39.996841159"
Oct 30 10:45:03.568146 ip-10-0-132-202 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 10:45:03.602736 ip-10-0-132-202 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 10:45:03.602905 ip-10-0-132-202 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 10:45:03.602962 ip-10-0-132-202 systemd[1]: kubelet.service: Consumed 2.237s CPU time.
Oct 30 10:45:03.612062 ip-10-0-132-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 10:45:03.705731 ip-10-0-132-202 kubenswrapper[4488]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:45:03.705731 ip-10-0-132-202 kubenswrapper[4488]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 10:45:03.705731 ip-10-0-132-202 kubenswrapper[4488]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:45:03.705731 ip-10-0-132-202 kubenswrapper[4488]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 10:45:03.711198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711110    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.711198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711196    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.711198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711202    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711206    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711211    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711215    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711220    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711224    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711228    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711232    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711236    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711241    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711245    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711249    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711253    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711258    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711262    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711267    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711271    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711275    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711280    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711284    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.711403 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711288    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711292    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711296    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711300    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711304    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711309    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711313    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711318    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711322    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711326    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711330    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711335    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711359    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711364    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711368    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711373    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711377    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711382    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711386    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711390    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.712197 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711394    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711398    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711402    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711406    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711410    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711415    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711419    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711423    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711439    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711444    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711450    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711454    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711458    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711463    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711467    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711471    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711475    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711479    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711484    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711488    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.713012 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711493    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711497    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711501    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711505    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711510    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711514    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711518    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711522    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711526    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711530    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711537    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711543    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711549    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711554    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711559    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711563    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711567    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711571    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711575    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.714878 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711579    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711583    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711594    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711599    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711603    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711607    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711611    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711615    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711619    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711623    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711631    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711637    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711642    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711646    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711650    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711654    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711658    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711662    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711666    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711671    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.715651 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711675    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711679    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711684    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711688    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.711692    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712955    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712967    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712972    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712976    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712981    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712985    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712991    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712995    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.712999    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713003    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713017    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713022    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713026    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713030    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.716474 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713035    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713039    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713042    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713046    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713050    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713054    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713060    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713064    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713068    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713072    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713077    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713081    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713085    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713089    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713093    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713097    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713147    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713152    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713156    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.717230 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713160    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713164    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713169    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713173    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713177    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713181    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713185    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713189    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713193    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713197    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713210    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713214    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713219    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713223    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713227    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713231    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713235    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713239    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713245    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713250    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.718002 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713254    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713259    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713263    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713267    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713271    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713275    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713279    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713284    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713288    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713292    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713299    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713305    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713310    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713314    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713318    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713323    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713327    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713331    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713335    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.718855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713355    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713361    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713367    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713371    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713382    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713386    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713391    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713396    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713400    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713404    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713409    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713413    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713418    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713422    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713426    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713430    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713436    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713443    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713448    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.719619 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713453    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713458    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713463    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713467    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713471    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713475    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713479    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713483    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713486    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713489    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713492    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713496    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713498    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713501    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.713504    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714086    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714094    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714106    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714109    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714112    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.720401 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714115    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714117    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714121    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714124    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714127    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714129    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714132    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714135    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714137    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714140    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714142    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714145    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714148    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714151    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714153    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714155    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714158    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714161    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714163    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.721198 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714166    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714169    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714171    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714174    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714176    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714179    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714182    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714184    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714187    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714189    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714192    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714200    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714203    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714206    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714208    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714211    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714213    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714216    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714218    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714220    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.721959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714223    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714226    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714228    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714230    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714233    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714235    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714238    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714240    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714243    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714245    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714248    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714250    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714253    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714255    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714258    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714260    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714263    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714265    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714268    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.722790 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714270    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714273    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714276    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714278    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714281    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714289    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714292    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714294    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714297    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714300    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714302    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714305    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714307    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714312    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714316    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714318    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714321    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714331    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714335    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.723680 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714350    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714354    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714358    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714362    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714367    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714371    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714375    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714379    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714382    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714384    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714387    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714389    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714392    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714395    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714402    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714404    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714407    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714410    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714413    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714422    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.724468 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714425    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714428    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714430    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.714435    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714533    4488 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714552    4488 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714564    4488 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714568    4488 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714573    4488 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714576    4488 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714581    4488 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714585    4488 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714588    4488 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714591    4488 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714594    4488 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714598    4488 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714601    4488 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714604    4488 flags.go:64] FLAG: --cgroup-root=""
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714607    4488 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714610    4488 flags.go:64] FLAG: --client-ca-file=""
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714613    4488 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714616    4488 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714623    4488 flags.go:64] FLAG: --cluster-domain=""
Oct 30 10:45:03.725258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714626    4488 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714629    4488 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714632    4488 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714637    4488 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714645    4488 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714649    4488 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714652    4488 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714656    4488 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714659    4488 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714667    4488 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714671    4488 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714674    4488 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714677    4488 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714681    4488 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714684    4488 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714687    4488 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714690    4488 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714693    4488 flags.go:64] FLAG: --enable-server="true"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714696    4488 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714703    4488 flags.go:64] FLAG: --event-burst="100"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714706    4488 flags.go:64] FLAG: --event-qps="50"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714710    4488 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714713    4488 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714715    4488 flags.go:64] FLAG: --eviction-hard=""
Oct 30 10:45:03.726183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714720    4488 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714723    4488 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714726    4488 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714729    4488 flags.go:64] FLAG: --eviction-soft=""
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714732    4488 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714735    4488 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714738    4488 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714741    4488 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714744    4488 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714747    4488 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714750    4488 flags.go:64] FLAG: --feature-gates=""
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714755    4488 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714760    4488 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714763    4488 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714766    4488 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714769    4488 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714772    4488 flags.go:64] FLAG: --help="false"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714775    4488 flags.go:64] FLAG: --hostname-override="ip-10-0-132-202.ec2.internal"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714785    4488 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714789    4488 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714792    4488 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714795    4488 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714799    4488 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714802    4488 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 10:45:03.727298 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714820    4488 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714824    4488 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714827    4488 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714831    4488 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714834    4488 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714837    4488 flags.go:64] FLAG: --kube-reserved=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714840    4488 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714843    4488 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714846    4488 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714849    4488 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714851    4488 flags.go:64] FLAG: --lock-file=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714854    4488 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714857    4488 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714860    4488 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714865    4488 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714868    4488 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714871    4488 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714874    4488 flags.go:64] FLAG: --logging-format="text"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714877    4488 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714884    4488 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714888    4488 flags.go:64] FLAG: --manifest-url=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714891    4488 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714896    4488 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714899    4488 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714907    4488 flags.go:64] FLAG: --max-pods="110"
Oct 30 10:45:03.728326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714910    4488 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714913    4488 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714922    4488 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714925    4488 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714928    4488 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714931    4488 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714934    4488 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714941    4488 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714944    4488 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714947    4488 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714950    4488 flags.go:64] FLAG: --pod-cidr=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714953    4488 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714956    4488 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714959    4488 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714962    4488 flags.go:64] FLAG: --port="10250"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714965    4488 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714968    4488 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1e117d635a670cf"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714971    4488 flags.go:64] FLAG: --qos-reserved=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714974    4488 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714978    4488 flags.go:64] FLAG: --register-node="true"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714981    4488 flags.go:64] FLAG: --register-with-taints=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714985    4488 flags.go:64] FLAG: --registry-burst="10"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714987    4488 flags.go:64] FLAG: --registry-qps="5"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714990    4488 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714994    4488 flags.go:64] FLAG: --reserved-memory=""
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.714998    4488 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 10:45:03.729357 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715002    4488 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715006    4488 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715009    4488 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715012    4488 flags.go:64] FLAG: --runonce="false"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715015    4488 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715018    4488 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715021    4488 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715024    4488 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715026    4488 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715035    4488 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715038    4488 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715041    4488 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715044    4488 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715047    4488 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715050    4488 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715053    4488 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715056    4488 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715059    4488 flags.go:64] FLAG: --system-cgroups=""
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715062    4488 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715067    4488 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715070    4488 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715072    4488 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715079    4488 flags.go:64] FLAG: --tls-min-version=""
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715082    4488 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715085    4488 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 10:45:03.730457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715088    4488 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715091    4488 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715094    4488 flags.go:64] FLAG: --v="2"
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715098    4488 flags.go:64] FLAG: --version="false"
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715102    4488 flags.go:64] FLAG: --vmodule=""
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715106    4488 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715109    4488 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715283    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715290    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715293    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715296    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715299    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715302    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715304    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715307    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715310    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715313    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715321    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715325    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715329    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.731470 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715332    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715335    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715337    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715352    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715355    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715358    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715361    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715364    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715367    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715369    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715372    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715374    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715377    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715380    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715383    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715385    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715388    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715391    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715393    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715398    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.732275 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715401    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715404    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715407    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715410    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715413    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715415    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715418    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715421    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715423    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715426    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715434    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715438    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715440    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715443    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715445    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715448    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715451    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715453    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715456    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715458    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.733093 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715461    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715463    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715466    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715469    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715471    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715474    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715477    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715479    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715482    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715484    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715487    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715490    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715494    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715497    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715499    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715502    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715504    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715507    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715510    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.733974 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715512    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715515    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715517    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715520    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715528    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715531    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715533    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715536    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715538    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715541    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715543    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715546    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715549    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715551    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715554    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715556    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715559    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715561    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715564    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715567    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.734756 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715569    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715571    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715574    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715577    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715581    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715585    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715588    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715592    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715595    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715598    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715601    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715603    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715606    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715608    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.715636    4488 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715672    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.735563 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715677    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715681    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715683    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715686    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715689    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715692    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715694    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715697    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715699    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715702    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715705    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715707    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715710    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715712    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715715    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715717    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715720    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715723    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715725    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715729    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.736200 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715733    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715740    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715743    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715746    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715748    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715751    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715754    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715756    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715759    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715762    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715764    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715767    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715769    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715772    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715775    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715778    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715780    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715785    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715789    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.737032 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715792    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715795    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715798    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715801    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715803    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715807    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715812    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715816    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715820    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715824    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715828    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715832    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715837    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715841    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715848    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715852    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715856    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715860    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715865    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715869    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.737806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715874    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715878    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715882    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715886    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715891    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715894    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715899    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715903    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715908    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715912    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715916    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715921    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715925    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715930    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715934    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715938    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715942    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715946    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715951    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715955    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.738618 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715959    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715963    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715967    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715972    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715976    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715980    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715987    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715991    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.715995    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716000    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716004    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716008    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716012    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716016    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716021    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716025    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716029    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716033    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716038    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.739452 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716042    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716046    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716051    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716055    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716059    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716064    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.716077    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.719880    4488 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.719892    4488 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.719911    4488 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.719915    4488 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719967    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719972    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719976    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719979    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719982    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719985    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719988    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719991    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.740228 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719993    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719996    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.719999    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720001    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720004    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720006    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720009    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720011    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720014    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720017    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720019    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720023    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720026    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720029    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720032    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720035    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720038    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720041    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720056    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720060    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.741010 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720063    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720066    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720068    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720071    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720073    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720076    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720078    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720081    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720083    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720086    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720089    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720091    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720094    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720096    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720099    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720101    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720104    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720106    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720109    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720111    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.741818 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720115    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720118    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720120    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720123    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720126    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720128    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720131    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720134    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720137    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720139    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720143    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720147    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720150    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720152    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720155    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720158    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720160    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720163    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720166    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.742659 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720168    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720171    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720173    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720176    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720179    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720181    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720184    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720186    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720188    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720191    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720194    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720197    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720200    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720204    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720208    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720211    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720214    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720217    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720220    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.743446 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720222    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720225    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720227    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720230    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720233    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720236    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720238    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720241    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720243    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720246    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720248    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720251    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720253    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720256    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720258    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720261    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720263    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720266    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720268    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.744192 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720271    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.720296    4488 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720458    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720464    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720467    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720470    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720472    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720475    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720478    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720481    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720484    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720486    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720489    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720492    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720494    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720497    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.744957 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720499    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720502    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720505    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720508    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720510    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720513    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720516    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720518    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720521    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720523    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720526    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720528    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720531    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720534    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720536    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720539    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720545    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720548    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720550    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.745698 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720553    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720555    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720558    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720561    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720563    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720566    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720569    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720571    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720574    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720576    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720579    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720581    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720584    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720587    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720589    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720592    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720595    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720597    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720600    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720603    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.746523 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720605    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720608    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720610    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720613    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720615    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720618    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720621    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720623    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720626    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720630    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720635    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720639    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720641    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720645    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720648    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720651    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720655    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720660    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720663    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.747354 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720667    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720670    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720673    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720676    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720678    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720681    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720683    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720686    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720688    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720691    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720694    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720697    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720699    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720702    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720704    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720707    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720709    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720712    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720714    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.748116 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720717    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720719    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720722    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720726    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720729    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720732    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720734    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720737    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720740    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720742    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720746    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720749    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720752    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720754    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720757    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.720779    4488 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 10:45:03.748941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720813    4488 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720817    4488 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720820    4488 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720823    4488 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720826    4488 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720829    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720831    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720835    4488 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720838    4488 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720840    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720843    4488 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720846    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720849    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720851    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720854    4488 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720856    4488 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720859    4488 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720861    4488 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720864    4488 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720866    4488 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 10:45:03.749591 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720871    4488 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 10:45:03.749423 ip-10-0-132-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720873    4488 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720876    4488 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720878    4488 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720881    4488 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720884    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720888    4488 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720891    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720893    4488 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720896    4488 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720899    4488 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720901    4488 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720904    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720906    4488 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720909    4488 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720911    4488 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720914    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720916    4488 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720919    4488 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720922    4488 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 10:45:03.750583 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720930    4488 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720933    4488 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720936    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720938    4488 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720943    4488 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720946    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720949    4488 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720952    4488 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720954    4488 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720957    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720959    4488 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720963    4488 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720969    4488 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720972    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720975    4488 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720978    4488 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720980    4488 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720983    4488 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720987    4488 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 10:45:03.751427 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720989    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720992    4488 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720994    4488 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.720997    4488 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721000    4488 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721002    4488 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721005    4488 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721007    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721010    4488 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721012    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721015    4488 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721017    4488 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721020    4488 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721022    4488 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721031    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721034    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721037    4488 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721039    4488 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721042    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 10:45:03.752177 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721045    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721047    4488 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721050    4488 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721053    4488 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721055    4488 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721058    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721062    4488 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721064    4488 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721067    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721070    4488 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721072    4488 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721075    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721081    4488 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721084    4488 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721087    4488 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721089    4488 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721092    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721095    4488 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721097    4488 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721100    4488 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 10:45:03.752942 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721103    4488 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721105    4488 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721108    4488 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721110    4488 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721117    4488 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721120    4488 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721123    4488 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:03.721125    4488 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.721171    4488 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722133    4488 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722193    4488 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722404    4488 server.go:1014] "Starting client certificate rotation"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722535    4488 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722586    4488 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 10:39:23 +0000 UTC" deadline="2028-04-01 12:32:08.347481818 +0000 UTC"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722621    4488 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12457h47m4.624863808s"
Oct 30 10:45:03.753732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.722920    4488 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 10:45:03.754353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.724377    4488 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 10:45:03.754353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.725844    4488 log.go:25] "Validated CRI v1 runtime API"
Oct 30 10:45:03.754353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.730445    4488 log.go:25] "Validated CRI v1 image API"
Oct 30 10:45:03.754353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.731249    4488 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 10:45:03.754353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.732725    4488 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87d29c75-d268-4d81-8e2c-5f607bb78a28:/dev/nvme0n1p3 e78816f4-23ff-4bb7-91dc-0e51ce0ad7f3:/dev/nvme0n1p4]
Oct 30 10:45:03.754578 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.732749    4488 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/146cc7b1dd83bf8fc41a63f863a118c9e35228991586e8ad13f294c533f54e77/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/146cc7b1dd83bf8fc41a63f863a118c9e35228991586e8ad13f294c533f54e77/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/56a7bf6c141e8f90b96782077d4b027795a38471d0ecb2dd0eb0df35c61d50c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/56a7bf6c141e8f90b96782077d4b027795a38471d0ecb2dd0eb0df35c61d50c6/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0eabd736-4d90-410f-bc80-ff82deb9f1d4/volumes/kubernetes.io~projected/kube-api-access-xcq6h:{mountpoint:/var/lib/kubelet/pods/0eabd736-4d90-410f-bc80-ff82deb9f1d4/volumes/kubernetes.io~projected/kube-api-access-xcq6h major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32f1b53e-4413-4ccf-a089-5eea6f3451af/volumes/kubernetes.io~projected/kube-api-access-hmptj:{mountpoint:/var/lib/kubelet/pods/32f1b53e-4413-4ccf-a089-5eea6f3451af/volumes/kubernetes.io~projected/kube-api-access-hmptj major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/374b9fb3-2f09-480d-8524-d33ea5e0a447/volumes/kubernetes.io~projected/kube-api-access-lcm8j:{mountpoint:/var/lib/kubelet/pods/374b9fb3-2f09-480d-8524-d33ea5e0a447/volumes/kubernetes.io~projected/kube-api-access-lcm8j major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~projected/kube-api-access-kcpgt:{mountpoint:/var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~projected/kube-api-access-kcpgt major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~secret/signing-key major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/44c3ae5c-be13-4495-88f8-7641798932b1/volumes/kubernetes.io~projected/kube-api-access-29q5f:{mountpoint:/var/lib/kubelet/pods/44c3ae5c-be13-4495-88f8-7641798932b1/volumes/kubernetes.io~projected/kube-api-access-29q5f major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~projected/kube-api-access-fct6z:{mountpoint:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~projected/kube-api-access-fct6z major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5594bd53-9510-41ba-831f-1835fd1b343f/volumes/kubernetes.io~projected/kube-api-access-vp4xp:{mountpoint:/var/lib/kubelet/pods/5594bd53-9510-41ba-831f-1835fd1b343f/volumes/kubernetes.io~projected/kube-api-access-vp4xp major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76e63fa6-26d3-4247-96ff-15abbb584b6a/volumes/kubernetes.io~projected/kube-api-access-ntt7k:{mountpoint:/var/lib/kubelet/pods/76e63fa6-26d3-4247-96ff-15abbb584b6a/volumes/kubernetes.io~projected/kube-api-access-ntt7k major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e/volumes/kubernetes.io~projected/kube-api-access-7d4kc:{mountpoint:/var/lib/kubelet/pods/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e/volumes/kubernetes.io~projected/kube-api-access-7d4kc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/97a10c5e-3913-4e9c-95bd-86e60105cd87/volumes/kubernetes.io~projected/kube-api-access-8fvh7:{mountpoint:/var/lib/kubelet/pods/97a10c5e-3913-4e9c-95bd-86e60105cd87/volumes/kubernetes.io~projected/kube-api-access-8fvh7 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~projected/kube-api-access-4shzp:{mountpoint:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~projected/kube-api-access-4shzp major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0e60f44-aa7a-4f52-b343-cfd031e269a7/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/b0e60f44-aa7a-4f52-b343-cfd031e269a7/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b10894a7-4b13-4fd3-8a3d-74199059fd53/volumes/kubernetes.io~projected/kube-api-access-p77wc:{mountpoint:/var/lib/kubelet/pods/b10894a7-4b13-4fd3-8a3d-74199059fd53/volumes/kubernetes.io~projected/kube-api-access-p77wc major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b60d4b1b-34df-469b-aa6b-502402acc947/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/b60d4b1b-34df-469b-aa6b-502402acc947/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df1ca007-90f9-4966-b846-b7ef1185b06c/volumes/kubernetes.io~projected/kube-api-access-6g2vt:{mountpoint:/var/lib/kubelet/pods/df1ca007-90f9-4966-b846-b7ef1185b06c/volumes/kubernetes.io~projected/kube-api-access-6g2vt major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~projected/kube-api-access-48fnp:{mountpoint:/var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~projected/kube-api-access-48fnp major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffa94cb8-701b-4ca0-acb2-a013b8f85213/volumes/kubernetes.io~projected/kube-api-access-l8wxm:{mountpoint:/var/lib/kubelet/pods/ffa94cb8-701b-4ca0-acb2-a013b8f85213/volumes/kubernetes.io~projected/kube-api-access-l8wxm major:0 minor:61 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/d85c3c15bbc923fc0e30b03897807d9c32e686f9c1edd52dcc32c352fb6eb76c/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/27829b4c4cfe3168b96ff398709c76a8061076fd8bbd3961d168e6dff9097a05/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/edd8f61ffc7e02cae699475adfe960e7dc5268db8fac113bef0723e727a11906/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/a332f0267d8fd3d694d30c9fc245edc8e26285fdaf18392d3689fb1f6c4bbdf5/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/2dfc96dd93c7b52f6ad96cec63017b135bd70d635707ff1d65ba5172478a76a7/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/248ea4ebb21ca1e1619f1917e60c4277d3ff7fb377cc61102ad5844d5770e7b6/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/c889bb8b496cf290238322d5e6e6e689e5cce6f873abd3ce8ea73b72a9722bab/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/2d15c58f91bbe1e9ad55002e7b4c56e875a1b00749bfbec199d932ed1b5c4157/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/2a6e41b6bbcbb44b55fc638e3c64a56d41478685637e57a3ea6db3f975c3dbc5/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/4456816f1188aefda36b4631e57de1dcd26e302a0a78c2280ac2ebceaee4c9f7/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/7ddc7b24ba82c7f6105cf7beed765a50845f2aec48d689b6d17d9642c6036b2e/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/7635770d6099a70d125c5b9842a238544cac8dbaad5adcd3dbfe05c95594fc91/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/3543be01ff94b27f056909858e2fa0a0e5a2392fb098b61c0f0a03fc4711d119/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/4c51fd7e6d2a950131d5e3dfef50d32d21fc6ceaaeacaae596932ca553ac00f5/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/370731987d7633459c973b68e34217135d7ff86610b8ab02aee408fd413fa193/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/74ca2bc6669ac4f8d2ee656b0d8bc3d2560ccfd0af18e2a708a3dc058d45bad2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/68871b3037ca2e4e2b7ea18387b1f86fdf48e77d35c201162c8f155e353928b0/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/de6aba13c936fc851957135ab1462b33b422218eff01b2e4ac5efd351e1eb585/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/3b0570941bdfdddfbaedf7ef4bf2dc5a7239ca6757997944bebed3f8300a804d/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/2ef765c33d25119f2133255860bef24fa17efd55811b0458941266efc039f974/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e5012d0e32edd1be60c3af9d0c4770d79a6a93e903bd797868ed4200e55f8332/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/77fb912190f74bcf7e9827bf69d585a384f313cb9ed692cfb50101751f670765/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/3665d9d1e2db82655da101e1828fa2e2e232ff1fa84124ae022710f172d1371f/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/f5fcb187f1655465044685e6b131668b06463849fd62dc438d7c93eca7bbdf86/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/44cf5320fc09e571908b2242de6774dba84e6680aa21b3d873e4c4e87ba65ca8/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/d2f6f074fb824a4499712a12b235b5be036171f1d2d72b6e191583e99433308b/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/948f9570e9d1f03243ed84a5b4478d7a2119ea4d5775a35b1b856ce9861b742a/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-234:{mountpoint:/var/lib/containers/storage/overlay/78aba531f95ca635104eabb976eba1546c60cdd02104169eae6c5fa4e2684364/merged major:0 minor:234 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/fc4ddc524841e87ecfbbd5f04d78fc669a0a6108389e3140a102bab27da23274/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-238:{mountpoint:/var/lib/containers/storage/overlay/2462621df39409ad114bd1d21214c994d734865ae21d8975b18588a8402ead8f/merged major:0 minor:238 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/5c1ef025bb4334b33a67b3b7031fe0d751f5e9ed41ba9eeeccb770c804874522/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/b35539eb7701cb584d7cbf71bda21b9f85165a888a09b14b7a703b219d32e502/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/11ea9555e9bb36d888694cf16ab3f4828bafe2649ede5ed2a6385d2b6f2c982d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/2a00452a202401b56243d80305fb08cc237cca171b8d9e1a28efe7969b2c1d82/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/14f3abe12efdcaff0c93acdb98cc033541a5abab21cf4f1839050b4712bb5053/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/0511eac99c2b6640d207efaea1dcc40fd9cb9d6c72fa4719a6f23b286583fb14/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/881978809e0e2103fe0ff8c094a534f6a378d8e746c5f1d9fd56fd659181a8c0/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-85:{mountpoint:/var/lib/containers/storage/overlay/9eaf9cfb222b416b027d576ee5a9a3508cbf5f161eb4b0efc9ef61e37cb28d19/merged major:0 minor:85 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/ba1b3d23850e831beb887bcd3a6fc3ad5c027fe7ee04402377f4a70766d70ac4/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/2895b0d6baedb16be67566cd88912efe020ddf824acd8e75c1267c8b00f4639a/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/930820caf09bb0684616f2d3267137f4f3db6752107396ef8f0f1c4e1d3c02ed/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739164    4488 manager.go:217] Machine: {Timestamp:2026-10-30 10:45:03.738722403 +0000 UTC m=+0.084314248 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100018 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f9d6fa583f45d1154fe296ff11d88 SystemUUID:ec2f9d6f-a583-f45d-1154-fe296ff11d88 BootID:6474dd9f-ba2b-46f8-97ca-4768272b68a0 Filesystems:[{Device:/run/containers/storage/overlay-containers/146cc7b1dd83bf8fc41a63f863a118c9e35228991586e8ad13f294c533f54e77/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2011b6a422617ee78b018e2b8a5609fc301f78779f391310d216c5c457b0b804/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5594bd53-9510-41ba-831f-1835fd1b343f/volumes/kubernetes.io~projected/kube-api-access-vp4xp DeviceMajor:0 DeviceMinor:213 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ffa94cb8-701b-4ca0-acb2-a013b8f85213/volumes/kubernetes.io~projected/kube-api-access-l8wxm DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e/volumes/kubernetes.io~projected/kube-api-access-7d4kc DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a429ee6d61a0deff4eacc4232189ca3e6053ccde591c82ab49f136473764415/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~projected/kube-api-access-4shzp DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8514f93c6ea289a4b8af35c6180e9249f7fc993eb3221c47a84abf5fe4a05629/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b60d4b1b-34df-469b-aa6b-502402acc947/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/76e63fa6-26d3-4247-96ff-15abbb584b6a/volumes/kubernetes.io~projected/kube-api-access-ntt7k DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6bcdfd00ae550f380434debebded4b1adf4fe1c575faaefda900391ce5025dec/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/44c3ae5c-be13-4495-88f8-7641798932b1/volumes/kubernetes.io~projected/kube-api-access-29q5f DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4726231b0e1d86074d6e0371c7a6daef3aaa190d968e6fc97478211c5f4bcf88/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/97a10c5e-3913-4e9c-95bd-86e60105cd87/volumes/kubernetes.io~projected/kube-api-access-8fvh7 DeviceMajor:0 DeviceMinor:222 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/119d408f45c9d67966ce35d574ff38348108cb2ef7e9cc406379cbc6f43458e6/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/32f1b53e-4413-4ccf-a089-5eea6f3451af/volumes/kubernetes.io~projected/kube-api-access-hmptj DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/56a7bf6c141e8f90b96782077d4b027795a38471d0ecb2dd0eb0df35c61d50c6/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5263141c0ccebcf5d54e5c347bdadbe77b310a2dcde029bfe00ebc59da50e30/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/98178842-8ce7-47da-9867-7315ab84bbe6/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fc0a58af542b889361fd7bcef2989fc7b00cd390bf7dfc961f31e1c891222f67/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b0e60f44-aa7a-4f52-b343-cfd031e269a7/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/997731608cbf1247dbf905a4644027945be6f68ee745e0b07c83bb2338ae2183/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1686ad04aa51def77fab9c054effe72b9b27432b1e6cee8544c7303ea57cd34c/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~projected/kube-api-access-kcpgt DeviceMajor:0 DeviceMinor:229 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0eabd736-4d90-410f-bc80-ff82deb9f1d4/volumes/kubernetes.io~projected/kube-api-access-xcq6h DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/df1ca007-90f9-4966-b846-b7ef1185b06c/volumes/kubernetes.io~projected/kube-api-access-6g2vt DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b10894a7-4b13-4fd3-8a3d-74199059fd53/volumes/kubernetes.io~projected/kube-api-access-p77wc DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4018b54d-5430-4001-83da-47203f44ff0f/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:228 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-234 DeviceMajor:0 DeviceMinor:234 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-238 DeviceMajor:0 DeviceMinor:238 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79/volumes/kubernetes.io~projected/kube-api-access-fct6z DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e09c17dd-ed06-461b-9cdc-d2ad16557bbc/volumes/kubernetes.io~projected/kube-api-access-48fnp DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/374b9fb3-2f09-480d-8524-d33ea5e0a447/volumes/kubernetes.io~projected/kube-api-access-lcm8j DeviceMajor:0 DeviceMinor:223 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-85 DeviceMajor:0 DeviceMinor:85 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:146cc7b1dd83bf8 MacAddress:82:c3:0c:70:43:21 Speed:10000 Mtu:8901} {Name:2a429ee6d61a0de MacAddress:b2:7d:3a:b7:52:1a Speed:10000 Mtu:8901} {Name:56a7bf6c141e8f9 MacAddress:c6:af:38:c7:4b:7e Speed:10000 Mtu:8901} {Name:bf14f63401347c3 MacAddress:ca:79:b9:36:c1:01 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e4:84:34:47 Speed:0 Mtu:9001} {Name:br-int MacAddress:a2:c0:80:05:49:63 Speed:0 Mtu:8901} {Name:d5263141c0ccebc MacAddress:3a:84:64:2c:0a:33 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:e4:84:34:47 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:36:86:ba:20:fd:9f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ca:61:31:64:e7:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739420    4488 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739461    4488 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739771    4488 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739788    4488 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739908    4488 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739916    4488 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739929    4488 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.739940    4488 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740019    4488 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740180    4488 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740283    4488 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740315    4488 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740330    4488 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740359    4488 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740371    4488 kubelet.go:405] "Adding apiserver pod source"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.740382    4488 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.741097    4488 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.741110    4488 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.741856    4488 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.744602    4488 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.744615    4488 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.744720    4488 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.744944    4488 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.744984    4488 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745109    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745128    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745162    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745171    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745181    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745189    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745198    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745208    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745219    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745229    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745243    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745258    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745290    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.745299    4488 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.748853    4488 server.go:1263] "Started kubelet"
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.749124    4488 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.750526    4488 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 10:45:03.754798 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.750592    4488 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 10:45:03.756913 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.755031    4488 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 10:45:03.756913 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.756330    4488 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 10:45:03.758612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.758594    4488 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 10:45:03.758837 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.758820    4488 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 10:45:03.761013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.759172    4488 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 10:45:03.761013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.759187    4488 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 10:45:03.761013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.759258    4488 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 10:45:03.761013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.760596    4488 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 10:39:25 +0000 UTC" deadline="2028-04-07 17:22:18.700287828 +0000 UTC"
Oct 30 10:45:03.761013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.760617    4488 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12606h37m14.939675341s"
Oct 30 10:45:03.762164 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.761609    4488 factory.go:55] Registering systemd factory
Oct 30 10:45:03.762164 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.761627    4488 factory.go:223] Registration of the systemd container factory successfully
Oct 30 10:45:03.762164 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.761839    4488 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Oct 30 10:45:03.762815 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.762796    4488 factory.go:153] Registering CRI-O factory
Oct 30 10:45:03.762815 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.762817    4488 factory.go:223] Registration of the crio container factory successfully
Oct 30 10:45:03.762937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.762865    4488 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 10:45:03.762937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.762881    4488 factory.go:103] Registering Raw factory
Oct 30 10:45:03.762937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.762895    4488 manager.go:1199] Started watching for new ooms in manager
Oct 30 10:45:03.763219 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.763207    4488 manager.go:319] Starting recovery of all containers
Oct 30 10:45:03.764395 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764360    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b95c22c-bc52-4b87-bdca-0da8ad7b0b79" volumeName="kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides" seLinuxMountContext=""
Oct 30 10:45:03.764460 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764399    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76e63fa6-26d3-4247-96ff-15abbb584b6a" volumeName="kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k" seLinuxMountContext=""
Oct 30 10:45:03.764460 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764415    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e" volumeName="kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc" seLinuxMountContext=""
Oct 30 10:45:03.764460 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764428    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="97a10c5e-3913-4e9c-95bd-86e60105cd87" volumeName="kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7" seLinuxMountContext=""
Oct 30 10:45:03.764460 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764441    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98178842-8ce7-47da-9867-7315ab84bbe6" volumeName="kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp" seLinuxMountContext=""
Oct 30 10:45:03.764460 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764454    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b60d4b1b-34df-469b-aa6b-502402acc947" volumeName="kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764468    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="44c3ae5c-be13-4495-88f8-7641798932b1" volumeName="kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764481    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b95c22c-bc52-4b87-bdca-0da8ad7b0b79" volumeName="kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764496    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b10894a7-4b13-4fd3-8a3d-74199059fd53" volumeName="kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764510    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df1ca007-90f9-4966-b846-b7ef1185b06c" volumeName="kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764523    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32f1b53e-4413-4ccf-a089-5eea6f3451af" volumeName="kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764534    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4018b54d-5430-4001-83da-47203f44ff0f" volumeName="kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764548    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0e60f44-aa7a-4f52-b343-cfd031e269a7" volumeName="kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764561    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b10894a7-4b13-4fd3-8a3d-74199059fd53" volumeName="kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764594    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="374b9fb3-2f09-480d-8524-d33ea5e0a447" volumeName="kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764608    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98178842-8ce7-47da-9867-7315ab84bbe6" volumeName="kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764620    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e09c17dd-ed06-461b-9cdc-d2ad16557bbc" volumeName="kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764633    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0eabd736-4d90-410f-bc80-ff82deb9f1d4" volumeName="kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764646    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32f1b53e-4413-4ccf-a089-5eea6f3451af" volumeName="kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764667    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32f1b53e-4413-4ccf-a089-5eea6f3451af" volumeName="kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 10:45:03.764682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764679    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="374b9fb3-2f09-480d-8524-d33ea5e0a447" volumeName="kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764692    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5594bd53-9510-41ba-831f-1835fd1b343f" volumeName="kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764705    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76e63fa6-26d3-4247-96ff-15abbb584b6a" volumeName="kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764717    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="97a10c5e-3913-4e9c-95bd-86e60105cd87" volumeName="kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764733    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98178842-8ce7-47da-9867-7315ab84bbe6" volumeName="kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764746    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0eabd736-4d90-410f-bc80-ff82deb9f1d4" volumeName="kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764762    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="374b9fb3-2f09-480d-8524-d33ea5e0a447" volumeName="kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764774    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df1ca007-90f9-4966-b846-b7ef1185b06c" volumeName="kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764795    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffa94cb8-701b-4ca0-acb2-a013b8f85213" volumeName="kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764809    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32f1b53e-4413-4ccf-a089-5eea6f3451af" volumeName="kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764833    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4018b54d-5430-4001-83da-47203f44ff0f" volumeName="kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764844    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b95c22c-bc52-4b87-bdca-0da8ad7b0b79" volumeName="kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764856    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b95c22c-bc52-4b87-bdca-0da8ad7b0b79" volumeName="kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764867    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b10894a7-4b13-4fd3-8a3d-74199059fd53" volumeName="kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764880    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df1ca007-90f9-4966-b846-b7ef1185b06c" volumeName="kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764892    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e09c17dd-ed06-461b-9cdc-d2ad16557bbc" volumeName="kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764904    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffa94cb8-701b-4ca0-acb2-a013b8f85213" volumeName="kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764916    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="374b9fb3-2f09-480d-8524-d33ea5e0a447" volumeName="kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764928    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4018b54d-5430-4001-83da-47203f44ff0f" volumeName="kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764939    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b95c22c-bc52-4b87-bdca-0da8ad7b0b79" volumeName="kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764950    4488 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0e60f44-aa7a-4f52-b343-cfd031e269a7" volumeName="kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca" seLinuxMountContext=""
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764961    4488 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 10:45:03.765366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.764968    4488 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 10:45:03.795498 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.795465    4488 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 10:45:03.796664 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.796645    4488 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 10:45:03.796664 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.796667    4488 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 10:45:03.796914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.796903    4488 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 10:45:03.796966 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.796937    4488 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 10:45:03.816332 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.816309    4488 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:45:03.819522 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.819470    4488 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 10:45:03.830638 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.830618    4488 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:45:03.832886 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.832862    4488 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:45:03.832968 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.832883    4488 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 10:45:03.834230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834195    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="d2f44fb7b7fc5e81d0aca83e7a58166f4b24ebc5b755598c8ec3dd1f8069b4a4" exitCode=0
Oct 30 10:45:03.834230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834229    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="f45c3af81f42e59b791340d477161ce1e06624b602f42e52eaf18e93fddcf685" exitCode=0
Oct 30 10:45:03.834397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834236    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="5745022dba777218e4e724bf5bea16e3f36256467e64bbf0dfa9428d6b4e94c2" exitCode=0
Oct 30 10:45:03.834397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834242    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="47b6b8007b41f4247647d193e0c89df2809a97cf223e888656c9be02e06ba544" exitCode=0
Oct 30 10:45:03.834397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834247    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="f7135a132eab508d4195baba3f46548a18168db5608a6d1a0b91a0ec7c5f728f" exitCode=0
Oct 30 10:45:03.834397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.834253    4488 generic.go:356] "Generic (PLEG): container finished" podID="32f1b53e-4413-4ccf-a089-5eea6f3451af" containerID="33de8c8f409ac9eabfb7577444160498d8950a78d8b461a3a9197de669d41952" exitCode=0
Oct 30 10:45:03.840844 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.840820    4488 generic.go:356] "Generic (PLEG): container finished" podID="dea3b5076a68f9927518ca754f7c3120" containerID="f3ec83ae7bc452a0406859d86a8144218d925a2612971b4485097ac9013b1efa" exitCode=0
Oct 30 10:45:03.855583 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.855568    4488 manager.go:324] Recovery completed
Oct 30 10:45:03.870230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870217    4488 cpu_manager.go:226] "Starting" policy="none"
Oct 30 10:45:03.870230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870227    4488 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 10:45:03.870321 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870242    4488 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 10:45:03.870410 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870396    4488 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 10:45:03.870440 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870410    4488 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 10:45:03.870440 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870428    4488 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 10:45:03.870440 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870434    4488 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 10:45:03.870440 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870439    4488 policy_none.go:50] "Start"
Oct 30 10:45:03.870552 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870447    4488 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 10:45:03.870552 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.870456    4488 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 10:45:03.887254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.887240    4488 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 10:45:03.887254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.887255    4488 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 10:45:03.887370 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.887262    4488 policy_none.go:44] "Start"
Oct 30 10:45:03.891212 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.891188    4488 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 10:45:03.895641 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.895629    4488 manager.go:341] "Starting Device Plugin manager"
Oct 30 10:45:03.896079 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.895652    4488 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 10:45:03.896134 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.896082    4488 server.go:87] "Starting device plugin registration server"
Oct 30 10:45:03.896371 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.896358    4488 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 10:45:03.896425 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.896373    4488 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 10:45:03.896522 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.896506    4488 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 10:45:03.897216 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897159    4488 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"]
Oct 30 10:45:03.897216 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897195    4488 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 10:45:03.897381 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897226    4488 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 10:45:03.897381 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897231    4488 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 10:45:03.897381 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897286    4488 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T10:45:03.897218271Z","UUID":"7ab2a268-377e-4e92-a935-187f94d780d2","Handler":null,"Name":"","Endpoint":""}
Oct 30 10:45:03.897860 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.897831    4488 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 10:45:03.897937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897876    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"be533252ce0dba51bc9516009d3c38bb","Type":"ContainerStarted","Data":"0d3abe3ffe4979cb57218d5a48ee83442f6127b9c72ef3d75f23742371c5c9b9"}
Oct 30 10:45:03.897937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897912    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"be533252ce0dba51bc9516009d3c38bb","Type":"ContainerStarted","Data":"4795e42647f81bf24025221b8e916239b106a5f7f1135b19e0075e85011e7eae"}
Oct 30 10:45:03.898030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897950    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerStarted","Data":"66dfb10eaf093fbbd669cb871279271d5b14946539c89e4646329495093c07d1"}
Oct 30 10:45:03.898030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897962    4488 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:03.898030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897972    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerDied","Data":"f3ec83ae7bc452a0406859d86a8144218d925a2612971b4485097ac9013b1efa"}
Oct 30 10:45:03.898030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.897991    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"dea3b5076a68f9927518ca754f7c3120","Type":"ContainerStarted","Data":"e23dff45c2e554c33dcfe65a727cd21080c36ebb754ae0ef20ba1f16ab75127b"}
Oct 30 10:45:03.898211 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.898112    4488 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:03.898720 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.898701    4488 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 10:45:03.898807 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.898736    4488 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 10:45:03.921679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.921660    4488 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 10:45:03.921769 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.921714    4488 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:03.922286 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.922273    4488 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 10:45:03.922376 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:03.922308    4488 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:03.996922 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.996900    4488 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 10:45:03.997990 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.997973    4488 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 10:45:03.998073 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.998002    4488 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 10:45:03.998073 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.998018    4488 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 10:45:03.998073 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:03.998048    4488 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.020461 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.020437    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.020544 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.020463    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.020544 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.020481    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.054144 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.054126    4488 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.054232 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.054178    4488 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.120948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120855    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.120948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120895    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be533252ce0dba51bc9516009d3c38bb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"be533252ce0dba51bc9516009d3c38bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.120948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120924    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.120948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120941    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.121117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120984    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.121117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.120979    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea3b5076a68f9927518ca754f7c3120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"dea3b5076a68f9927518ca754f7c3120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.741984 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.741958    4488 apiserver.go:52] "Watching apiserver"
Oct 30 10:45:04.786963 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.786937    4488 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 10:45:04.787404 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.787383    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mk6zq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4","openshift-dns/node-resolver-m42hf","openshift-insights/periodic-gathering-nnxpr-ffxxk","openshift-network-operator/iptables-alerter-qm9wr","openshift-dns/dns-default-sn9kw","openshift-multus/network-metrics-daemon-h9mjb","kube-system/konnectivity-agent-llcdz","openshift-ovn-kubernetes/ovnkube-node-prv2b","openshift-network-diagnostics/network-check-target-tvvbs","kube-system/global-pull-secret-syncer-25rss","openshift-cluster-node-tuning-operator/tuned-fsdk6","openshift-insights/insights-runtime-extractor-dpvzb","openshift-multus/multus-7fqs2","openshift-service-ca/service-ca-5fffc97bdf-wkdk9","openshift-multus/multus-additional-cni-plugins-m8kgs","openshift-image-registry/node-ca-pzbfk","kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"]
Oct 30 10:45:04.793359 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.793319    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:04.795146 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.795127    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.795522 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.795506    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.804256 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804238    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.804471 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804454    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.804630 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804612    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.804682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804673    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.804738 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804710    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.804868 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804850    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.804925 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804913    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 10:45:04.804972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804936    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s5t5b\""
Oct 30 10:45:04.805024 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.804994    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-55bss\""
Oct 30 10:45:04.805387 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805367    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 10:45:04.805443 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805416    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 10:45:04.805480 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805439    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 10:45:04.805653 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805623    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.805774 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805654    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.805774 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805680    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.805774 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805693    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 10:45:04.806030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805811    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.806030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.805938    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.806030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806010    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 10:45:04.806230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806041    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-472bd\""
Oct 30 10:45:04.806230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806069    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5fdc6\""
Oct 30 10:45:04.806230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806115    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 10:45:04.806230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806187    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9pzxh\""
Oct 30 10:45:04.806396 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.806262    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vwt65\""
Oct 30 10:45:04.810526 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.810505    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.810729 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.810707    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lntjm\""
Oct 30 10:45:04.810846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.810736    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c9pg5\""
Oct 30 10:45:04.810846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.810815    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 10:45:04.810925 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.810871    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.811023 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.811012    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 10:45:04.811058 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.811024    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 10:45:04.811058 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.811027    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.818154 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818140    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.818772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818752    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 10:45:04.818849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818789    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.818849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818800    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 10:45:04.818968 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818955    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 10:45:04.819021 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818966    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.819021 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818957    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 10:45:04.819021 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.818980    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.819169 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819095    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.819169 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819133    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 10:45:04.819240 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819179    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 10:45:04.819284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819270    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.819313 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819294    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 10:45:04.819384 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819374    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 10:45:04.819442 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819427    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 10:45:04.819476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819467    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 10:45:04.819511 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819485    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 10:45:04.819629 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819618    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 10:45:04.819691 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819660    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mhmcf\""
Oct 30 10:45:04.819723 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819713    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-r88l6\""
Oct 30 10:45:04.819823 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819811    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgw7c\""
Oct 30 10:45:04.819855 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819813    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-vmnnx\""
Oct 30 10:45:04.819907 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819892    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 10:45:04.819946 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819936    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xt7nj\""
Oct 30 10:45:04.819977 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819969    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 10:45:04.820005 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.819975    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 10:45:04.820035 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.820014    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ghh8s\""
Oct 30 10:45:04.820080 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.820070    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mnv22\""
Oct 30 10:45:04.820130 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.820122    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wj9xd\""
Oct 30 10:45:04.820169 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.820156    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sssm5\""
Oct 30 10:45:04.822139 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.822125    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 10:45:04.853271 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.853252    4488 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.860219 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.860202    4488 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 10:45:04.877120 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.877101    4488 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 10:45:04.877203 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:04.877135    4488 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Oct 30 10:45:04.924685 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924662    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.924760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924689    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.924760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924710    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:04.924760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924726    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:04.924760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924747    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.924914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924769    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:04.924914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924807    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:04.924914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924830    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.924914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924854    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:04.924914 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924880    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924953    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924953    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.924999    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4018b54d-5430-4001-83da-47203f44ff0f-signing-cabundle\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925048    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct6z\" (UniqueName: \"kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925079    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffa94cb8-701b-4ca0-acb2-a013b8f85213-iptables-alerter-script\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925090    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.925117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925111    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48fnp\" (UniqueName: \"kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925148    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-script-lib\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925162    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925166    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df1ca007-90f9-4966-b846-b7ef1185b06c-tmp-dir\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925216    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b60d4b1b-34df-469b-aa6b-502402acc947-original-pull-secret\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925242    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925270    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shzp\" (UniqueName: \"kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925286    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcq6h\" (UniqueName: \"kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925388    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925416    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925439    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925462    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925492    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925525    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925554    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925560    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925587    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925610    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925623    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76e63fa6-26d3-4247-96ff-15abbb584b6a-tmp-dir\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925640    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925672    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925731    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4018b54d-5430-4001-83da-47203f44ff0f-signing-key\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925735    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925759    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97a10c5e-3913-4e9c-95bd-86e60105cd87-data-volume\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925775    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925791    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925810    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925825    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29q5f\" (UniqueName: \"kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.925830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925838    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925844    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-tmp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925853    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.925895    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntt7k\" (UniqueName: \"kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926217    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926238    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926255    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926271    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926382    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926425    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926459    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926485    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926503    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926547    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926555    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-cni-binary-copy\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926574    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926591    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-daemon-config\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926605    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926634    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926657    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926665    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-cert\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926703    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926742    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmptj\" (UniqueName: \"kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926766    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926852    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.926873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926867    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926882    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926926    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926953    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.926990    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927011    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927043    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927110    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927135    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927160    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927208    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927270    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927296    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927327    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927383    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p77wc\" (UniqueName: \"kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927386    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df1ca007-90f9-4966-b846-b7ef1185b06c-config-volume\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927408    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e60f44-aa7a-4f52-b343-cfd031e269a7-konnectivity-ca\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927433    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.927504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927461    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927515    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2vt\" (UniqueName: \"kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927585    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927623    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927650    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d4kc\" (UniqueName: \"kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927676    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927701    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927723    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927739    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927768    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927803    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927834    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927845    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-env-overrides\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927858    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927884    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927907    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927912    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927946    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927977    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.927996    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928012    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928027    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928041    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wxm\" (UniqueName: \"kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928059    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928086    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcpgt\" (UniqueName: \"kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928109    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928118    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98178842-8ce7-47da-9867-7315ab84bbe6-etc-tuned\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928124    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928141    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928251    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f1b53e-4413-4ccf-a089-5eea6f3451af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.928254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928260    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928388    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928410    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovnkube-config\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928408    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e60f44-aa7a-4f52-b343-cfd031e269a7-agent-certs\") pod \"konnectivity-agent-llcdz\" (UID: \"b0e60f44-aa7a-4f52-b343-cfd031e269a7\") " pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928424    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvh7\" (UniqueName: \"kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928462    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.928625    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0eabd736-4d90-410f-bc80-ff82deb9f1d4-serviceca\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:04.929608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.929536    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-ovn-node-metrics-cert\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.948114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948082    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shzp\" (UniqueName: \"kubernetes.io/projected/98178842-8ce7-47da-9867-7315ab84bbe6-kube-api-access-4shzp\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:04.948257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948239    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcq6h\" (UniqueName: \"kubernetes.io/projected/0eabd736-4d90-410f-bc80-ff82deb9f1d4-kube-api-access-xcq6h\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:04.948455 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948439    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48fnp\" (UniqueName: \"kubernetes.io/projected/e09c17dd-ed06-461b-9cdc-d2ad16557bbc-kube-api-access-48fnp\") pod \"ingress-canary-mk6zq\" (UID: \"e09c17dd-ed06-461b-9cdc-d2ad16557bbc\") " pod="openshift-ingress-canary/ingress-canary-mk6zq"
Oct 30 10:45:04.948697 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948682    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29q5f\" (UniqueName: \"kubernetes.io/projected/44c3ae5c-be13-4495-88f8-7641798932b1-kube-api-access-29q5f\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:04.948797 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948782    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntt7k\" (UniqueName: \"kubernetes.io/projected/76e63fa6-26d3-4247-96ff-15abbb584b6a-kube-api-access-ntt7k\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:04.948838 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948818    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct6z\" (UniqueName: \"kubernetes.io/projected/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-kube-api-access-fct6z\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:04.948978 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.948964    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"periodic-gathering-nnxpr-ffxxk\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") " pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:04.949416 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.949401    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmptj\" (UniqueName: \"kubernetes.io/projected/32f1b53e-4413-4ccf-a089-5eea6f3451af-kube-api-access-hmptj\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:04.950370 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.950354    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2vt\" (UniqueName: \"kubernetes.io/projected/df1ca007-90f9-4966-b846-b7ef1185b06c-kube-api-access-6g2vt\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:04.950591 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.950571    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d4kc\" (UniqueName: \"kubernetes.io/projected/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-kube-api-access-7d4kc\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:04.950624 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.950581    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p77wc\" (UniqueName: \"kubernetes.io/projected/b10894a7-4b13-4fd3-8a3d-74199059fd53-kube-api-access-p77wc\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:04.950769 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.950756    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4xp\" (UniqueName: \"kubernetes.io/projected/5594bd53-9510-41ba-831f-1835fd1b343f-kube-api-access-vp4xp\") pod \"network-check-target-tvvbs\" (UID: \"5594bd53-9510-41ba-831f-1835fd1b343f\") " pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:45:04.953289 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.953270    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wxm\" (UniqueName: \"kubernetes.io/projected/ffa94cb8-701b-4ca0-acb2-a013b8f85213-kube-api-access-l8wxm\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:04.953436 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.953421    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvh7\" (UniqueName: \"kubernetes.io/projected/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-api-access-8fvh7\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:04.953589 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:04.953574    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcpgt\" (UniqueName: \"kubernetes.io/projected/4018b54d-5430-4001-83da-47203f44ff0f-kube-api-access-kcpgt\") pod \"service-ca-5fffc97bdf-wkdk9\" (UID: \"4018b54d-5430-4001-83da-47203f44ff0f\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wkdk9"
Oct 30 10:45:05.028730 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028660    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.028730 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028695    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:05.028730 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028721    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028748    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028765    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-conf-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028775    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028782    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffa94cb8-701b-4ca0-acb2-a013b8f85213-host-slash\") pod \"iptables-alerter-qm9wr\" (UID: \"ffa94cb8-701b-4ca0-acb2-a013b8f85213\") " pod="openshift-network-operator/iptables-alerter-qm9wr"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028798    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028799    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028828    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-socket-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028830    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028849    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-systemd-units\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028852    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-device-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028859    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-slash\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028860    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028895    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028912    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028915    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-etc-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028929    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:05.028942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028950    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028964    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028970    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-kubelet-config\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028977    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-system-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.028981    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029002    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-log-socket\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029014    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029028    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-cni-dir\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029046    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76e63fa6-26d3-4247-96ff-15abbb584b6a-hosts-file\") pod \"node-resolver-m42hf\" (UID: \"76e63fa6-26d3-4247-96ff-15abbb584b6a\") " pod="openshift-dns/node-resolver-m42hf"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029041    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029044    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-netns\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029072    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029079    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-multus\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029095    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029115    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eabd736-4d90-410f-bc80-ff82deb9f1d4-host\") pod \"node-ca-pzbfk\" (UID: \"0eabd736-4d90-410f-bc80-ff82deb9f1d4\") " pod="openshift-image-registry/node-ca-pzbfk"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029141    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029162    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029159    4488 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029178    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029201    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029229    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029234    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-var-lib-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029261    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-bin\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029265    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-multus-certs\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029244    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97a10c5e-3913-4e9c-95bd-86e60105cd87-crio-socket\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029239    4488 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029284    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029245    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:45:05.529226505 +0000 UTC m=+1.874818356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : secret "metrics-daemon-secret" not found
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029373    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:45:05.529354163 +0000 UTC m=+1.874946011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029393    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029413    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029431    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029450    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029458    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-etc-kubernetes\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029476    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029492    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-run-k8s-cni-cncf-io\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029486    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-cnibin\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029499    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029494    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-openvswitch\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029530    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-kubernetes\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029532    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029556    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029559    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f1b53e-4413-4ccf-a089-5eea6f3451af-system-cni-dir\") pod \"multus-additional-cni-plugins-m8kgs\" (UID: \"32f1b53e-4413-4ccf-a089-5eea6f3451af\") " pod="openshift-multus/multus-additional-cni-plugins-m8kgs"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029575    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029598    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-hostroot\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029607    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-registration-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029612    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029619    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029649    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-systemd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029651    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029680    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-cni-netd\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029684    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029697    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-cni-bin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029712    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029728    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.029702 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029740    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029754    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029768    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029791    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029798    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-sys\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029799    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-run\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029812    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-host-var-lib-kubelet\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029815    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029830    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-node-log\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029843    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029867    4488 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029885    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-modprobe-d\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029867    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.029913    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:05.529901004 +0000 UTC m=+1.875492840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029868    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysconfig\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029912    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-var-lib-kubelet\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029939    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029967    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029979    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-lib-modules\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029969    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-kubelet\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.029995    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030000    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030018    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030022    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-cnibin\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030038    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030052    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030065    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b10894a7-4b13-4fd3-8a3d-74199059fd53-multus-socket-dir-parent\") pod \"multus-7fqs2\" (UID: \"b10894a7-4b13-4fd3-8a3d-74199059fd53\") " pod="openshift-multus/multus-7fqs2"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030065    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030100    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-systemd\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030120    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030136    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030153    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030167    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030184    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030187    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-etc-sysctl-conf\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030210    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b60d4b1b-34df-469b-aa6b-502402acc947-dbus\") pod \"global-pull-secret-syncer-25rss\" (UID: \"b60d4b1b-34df-469b-aa6b-502402acc947\") " pod="kube-system/global-pull-secret-syncer-25rss"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030223    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030237    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-sys-fs\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030243    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/44c3ae5c-be13-4495-88f8-7641798932b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9hz4\" (UID: \"44c3ae5c-be13-4495-88f8-7641798932b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9hz4"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030260    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-run-ovn\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030264    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030287    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030321    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b95c22c-bc52-4b87-bdca-0da8ad7b0b79-host-run-netns\") pod \"ovnkube-node-prv2b\" (UID: \"4b95c22c-bc52-4b87-bdca-0da8ad7b0b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030360    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98178842-8ce7-47da-9867-7315ab84bbe6-host\") pod \"tuned-fsdk6\" (UID: \"98178842-8ce7-47da-9867-7315ab84bbe6\") " pod="openshift-cluster-node-tuning-operator/tuned-fsdk6"
Oct 30 10:45:05.032131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.030546    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97a10c5e-3913-4e9c-95bd-86e60105cd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.534256 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.534218    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:05.534468 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.534275    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:05.534468 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:05.534294    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:05.534468 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534403    4488 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:45:05.534468 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534404    4488 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:05.534468 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534403    4488 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 10:45:05.534638 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534488    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:45:06.534468648 +0000 UTC m=+2.880060481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : secret "metrics-daemon-secret" not found
Oct 30 10:45:05.534638 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534504    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:45:06.534494262 +0000 UTC m=+2.880086094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:45:05.534638 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:05.534518    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:06.534512143 +0000 UTC m=+2.880103974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:06.540716 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:06.540680    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:06.540729    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:06.540746    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540829    4488 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540830    4488 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540836    4488 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540874    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls podName:df1ca007-90f9-4966-b846-b7ef1185b06c nodeName:}" failed. No retries permitted until 2026-10-30 10:45:08.54086234 +0000 UTC m=+4.886454185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls") pod "dns-default-sn9kw" (UID: "df1ca007-90f9-4966-b846-b7ef1185b06c") : secret "dns-default-metrics-tls" not found
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540907    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs podName:8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e nodeName:}" failed. No retries permitted until 2026-10-30 10:45:08.54089501 +0000 UTC m=+4.886486842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs") pod "network-metrics-daemon-h9mjb" (UID: "8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e") : secret "metrics-daemon-secret" not found
Oct 30 10:45:06.541226 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:06.540918    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:08.540911833 +0000 UTC m=+4.886503665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:06.848244 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:06.848177    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m42hf_76e63fa6-26d3-4247-96ff-15abbb584b6a/dns-node-resolver/0.log"
Oct 30 10:45:06.996723 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:06.996699    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:07.447738 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:07.447712    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pzbfk_0eabd736-4d90-410f-bc80-ff82deb9f1d4/node-ca/0.log"
Oct 30 10:45:07.569880 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:07.569854    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-llcdz"
Oct 30 10:45:08.448559 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.448523    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mk6zq_e09c17dd-ed06-461b-9cdc-d2ad16557bbc/serve-healthcheck-canary/0.log"
Oct 30 10:45:08.553822 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.553794    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:08.553951 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.553838    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:08.553951 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.553859    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:08.554020 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:08.553944    4488 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:08.554052 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:08.554019    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls podName:97a10c5e-3913-4e9c-95bd-86e60105cd87 nodeName:}" failed. No retries permitted until 2026-10-30 10:45:12.554006357 +0000 UTC m=+8.899598221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpvzb" (UID: "97a10c5e-3913-4e9c-95bd-86e60105cd87") : secret "insights-runtime-extractor-tls" not found
Oct 30 10:45:08.554253 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.554225    4488 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 10:45:08.556302 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.556285    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e-metrics-certs\") pod \"network-metrics-daemon-h9mjb\" (UID: \"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e\") " pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:08.556372 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.556356    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1ca007-90f9-4966-b846-b7ef1185b06c-metrics-tls\") pod \"dns-default-sn9kw\" (UID: \"df1ca007-90f9-4966-b846-b7ef1185b06c\") " pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:08.694020 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.693993    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9mjb"
Oct 30 10:45:08.696163 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.696148    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:08.754206 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.753534    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:45:08.999537 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:08.999514    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9mjb"]
Oct 30 10:45:09.000806 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:09.000774    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5beea4_fa0a_4bcf_be7e_4f1f19f4355e.slice/crio-a6bb90ffe56810e0536d6e0e37a0db74d1f0637c7fe07b6715aed222a479abce WatchSource:0}: Error finding container a6bb90ffe56810e0536d6e0e37a0db74d1f0637c7fe07b6715aed222a479abce: Status 404 returned error can't find the container with id a6bb90ffe56810e0536d6e0e37a0db74d1f0637c7fe07b6715aed222a479abce
Oct 30 10:45:09.002855 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.002834    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 10:45:09.014156 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.014136    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sn9kw"]
Oct 30 10:45:09.014855 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:09.014837    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1ca007_90f9_4966_b846_b7ef1185b06c.slice/crio-8eb15adcff3fc44d42da7a49528b998dc76f6527aecbe10d46e1d7271c249511 WatchSource:0}: Error finding container 8eb15adcff3fc44d42da7a49528b998dc76f6527aecbe10d46e1d7271c249511: Status 404 returned error can't find the container with id 8eb15adcff3fc44d42da7a49528b998dc76f6527aecbe10d46e1d7271c249511
Oct 30 10:45:09.553071 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.553026    4488 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-llcdz_b0e60f44-aa7a-4f52-b343-cfd031e269a7/konnectivity-agent/0.log" limit=1024
Oct 30 10:45:09.797230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.797198    4488 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-llcdz_b0e60f44-aa7a-4f52-b343-cfd031e269a7/konnectivity-agent/0.log" limit=1024
Oct 30 10:45:09.868707 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.868610    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9mjb" event={"ID":"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e","Type":"ContainerStarted","Data":"a6bb90ffe56810e0536d6e0e37a0db74d1f0637c7fe07b6715aed222a479abce"}
Oct 30 10:45:09.870807 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.870779    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sn9kw" event={"ID":"df1ca007-90f9-4966-b846-b7ef1185b06c","Type":"ContainerStarted","Data":"8eb15adcff3fc44d42da7a49528b998dc76f6527aecbe10d46e1d7271c249511"}
Oct 30 10:45:09.969012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:09.968954    4488 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-llcdz_b0e60f44-aa7a-4f52-b343-cfd031e269a7/konnectivity-agent/0.log" limit=1024
Oct 30 10:45:10.083832 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.083811    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:10.084124 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.084106    4488 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 10:45:10.341681 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.341649    4488 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-llcdz_b0e60f44-aa7a-4f52-b343-cfd031e269a7/konnectivity-agent/0.log" limit=1024
Oct 30 10:45:10.876408 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.876320    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9mjb" event={"ID":"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e","Type":"ContainerStarted","Data":"d8839e5c557f1e7b4bc146e14de88f2a83325ef3b772c2c44465018ae2cca5e9"}
Oct 30 10:45:10.876408 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.876394    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9mjb" event={"ID":"8b5beea4-fa0a-4bcf-be7e-4f1f19f4355e","Type":"ContainerStarted","Data":"718de2b73cee902910bbaccb26eb85c4ec0eb2ed9ce13a7a9df9ce9ebc7f014f"}
Oct 30 10:45:10.878192 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.878170    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sn9kw" event={"ID":"df1ca007-90f9-4966-b846-b7ef1185b06c","Type":"ContainerStarted","Data":"2706f47876f492e1d2b8ae7f8bcd97c3ae1971c2cf8fc80af86e125849b7693f"}
Oct 30 10:45:10.878316 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.878204    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sn9kw" event={"ID":"df1ca007-90f9-4966-b846-b7ef1185b06c","Type":"ContainerStarted","Data":"c9ed98450d1a51ebd60a9ba6b886c480f2116d9a9e8716ec11dc2451ce658b4e"}
Oct 30 10:45:10.878316 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:10.878296    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:12.584208 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:12.584173    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:12.586422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:12.586401    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97a10c5e-3913-4e9c-95bd-86e60105cd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpvzb\" (UID: \"97a10c5e-3913-4e9c-95bd-86e60105cd87\") " pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:12.596355 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:12.596324    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpvzb"
Oct 30 10:45:12.888273 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:12.888251    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpvzb"]
Oct 30 10:45:12.889477 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:12.889448    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a10c5e_3913_4e9c_95bd_86e60105cd87.slice/crio-3826165cd3cf8d16b5e010257f309b7f72e63c1deda76188f7cc3759f643952c WatchSource:0}: Error finding container 3826165cd3cf8d16b5e010257f309b7f72e63c1deda76188f7cc3759f643952c: Status 404 returned error can't find the container with id 3826165cd3cf8d16b5e010257f309b7f72e63c1deda76188f7cc3759f643952c
Oct 30 10:45:13.892452 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:13.892384    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpvzb" event={"ID":"97a10c5e-3913-4e9c-95bd-86e60105cd87","Type":"ContainerStarted","Data":"7f405d02cd2b8728f09d6851bc87f2fd283ebe1f53cf98dd62c95440e90d4101"}
Oct 30 10:45:13.892452 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:13.892438    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpvzb" event={"ID":"97a10c5e-3913-4e9c-95bd-86e60105cd87","Type":"ContainerStarted","Data":"272de71123ff83cd98ea8cd2a167885595c0db90c57a003121854b9f5d0da356"}
Oct 30 10:45:13.892835 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:13.892462    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpvzb" event={"ID":"97a10c5e-3913-4e9c-95bd-86e60105cd87","Type":"ContainerStarted","Data":"3826165cd3cf8d16b5e010257f309b7f72e63c1deda76188f7cc3759f643952c"}
Oct 30 10:45:14.897328 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:14.897297    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpvzb" event={"ID":"97a10c5e-3913-4e9c-95bd-86e60105cd87","Type":"ContainerStarted","Data":"9c0427e669b38cc25c2e943344618c3d52fb5f33789d9cc1e4922b476f7ae290"}
Oct 30 10:45:20.431478 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.431444    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:45:20.434401 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.434329    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"]
Oct 30 10:45:20.434539 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.434435    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.437304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.437283    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"
Oct 30 10:45:20.463690 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.463661    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4nlgm\""
Oct 30 10:45:20.464141 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.464123    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"]
Oct 30 10:45:20.477602 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.477582    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 10:45:20.477699 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.477602    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 10:45:20.478372 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.478326    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:45:20.530991 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.530966    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.531101 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.531002    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bnb\" (UniqueName: \"kubernetes.io/projected/a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b-kube-api-access-g8bnb\") pod \"migrator-66df5d496b-hltqq\" (UID: \"a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"
Oct 30 10:45:20.531101 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.531039    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.531101 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.531087    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.531220 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.531131    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbkl\" (UniqueName: \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.631999 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.631978    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.632102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632005    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.632102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632032    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbkl\" (UniqueName: \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.632102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632061    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.632102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632085    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bnb\" (UniqueName: \"kubernetes.io/projected/a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b-kube-api-access-g8bnb\") pod \"migrator-66df5d496b-hltqq\" (UID: \"a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"
Oct 30 10:45:20.632510 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632492    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.632790 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.632770    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.633029 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.633012    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.656673 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.656650    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bnb\" (UniqueName: \"kubernetes.io/projected/a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b-kube-api-access-g8bnb\") pod \"migrator-66df5d496b-hltqq\" (UID: \"a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"
Oct 30 10:45:20.656770 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.656674    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbkl\" (UniqueName: \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\") pod \"periodic-gathering-8p8p2-b2jk6\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") " pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.746958 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.746893    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:45:20.751932 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.751911    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"
Oct 30 10:45:20.884567 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:20.884544    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sn9kw"
Oct 30 10:45:21.047131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.047109    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:45:21.047753 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:21.047732    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1067af18_9e29_4775_9bf5_a648e451a59f.slice/crio-40d12fc4cb134960bcc7916ac8a303e0eeddbb4db311ee11ac5a4ef46b8cc1d8 WatchSource:0}: Error finding container 40d12fc4cb134960bcc7916ac8a303e0eeddbb4db311ee11ac5a4ef46b8cc1d8: Status 404 returned error can't find the container with id 40d12fc4cb134960bcc7916ac8a303e0eeddbb4db311ee11ac5a4ef46b8cc1d8
Oct 30 10:45:21.061453 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.061429    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq"]
Oct 30 10:45:21.062080 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:21.062055    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a0f6a2_4aba_4fb6_9fce_fb02a50d0d0b.slice/crio-e8ff1d6829f7f1f19121d560ff39415d7e42dbceeda90d2bf28d52bf5f7c6cee WatchSource:0}: Error finding container e8ff1d6829f7f1f19121d560ff39415d7e42dbceeda90d2bf28d52bf5f7c6cee: Status 404 returned error can't find the container with id e8ff1d6829f7f1f19121d560ff39415d7e42dbceeda90d2bf28d52bf5f7c6cee
Oct 30 10:45:21.922969 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.922935    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" event={"ID":"1067af18-9e29-4775-9bf5-a648e451a59f","Type":"ContainerStarted","Data":"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"}
Oct 30 10:45:21.923441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.922992    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" event={"ID":"1067af18-9e29-4775-9bf5-a648e451a59f","Type":"ContainerStarted","Data":"40d12fc4cb134960bcc7916ac8a303e0eeddbb4db311ee11ac5a4ef46b8cc1d8"}
Oct 30 10:45:21.924491 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.924467    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq" event={"ID":"a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b","Type":"ContainerStarted","Data":"e8ff1d6829f7f1f19121d560ff39415d7e42dbceeda90d2bf28d52bf5f7c6cee"}
Oct 30 10:45:21.967287 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:21.967227    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" podStartSLOduration=1.967214436 podStartE2EDuration="1.967214436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:21.967105432 +0000 UTC m=+18.312697306" watchObservedRunningTime="2026-10-30 10:45:21.967214436 +0000 UTC m=+18.312806286"
Oct 30 10:45:22.199005 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:22.198928    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prv2b"
Oct 30 10:45:22.929288 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:22.929251    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq" event={"ID":"a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b","Type":"ContainerStarted","Data":"3bb304595f0dd502b8ab82aa1b2a1645326eefe76f18deda57ab34ea407fc9e2"}
Oct 30 10:45:22.972376 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:22.972317    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hltqq" podStartSLOduration=2.057401181 podStartE2EDuration="2.972306827s" totalImagesPullingTime="914.905646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:22.971507128 +0000 UTC m=+19.317098981" watchObservedRunningTime="2026-10-30 10:45:22.972306827 +0000 UTC m=+19.317898681"
Oct 30 10:45:23.639087 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:23.639065    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sn9kw_df1ca007-90f9-4966-b846-b7ef1185b06c/dns/0.log"
Oct 30 10:45:23.838645 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:23.838619    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sn9kw_df1ca007-90f9-4966-b846-b7ef1185b06c/kube-rbac-proxy/0.log"
Oct 30 10:45:24.216714 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.216682    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"]
Oct 30 10:45:24.220016 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.219994    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.240056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.240036    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"]
Oct 30 10:45:24.253197 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.253178    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 10:45:24.253300 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.253286    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 10:45:24.253475 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.253455    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pzdbz\""
Oct 30 10:45:24.267405 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.267389    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 10:45:24.267405 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.267389    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 10:45:24.267516 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.267428    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 10:45:24.355938 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.355912    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.356008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.355948    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.356008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.355968    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61a4d7-422b-4728-825f-7a370b43b2ec-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.356109 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.356089    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmxw\" (UniqueName: \"kubernetes.io/projected/9a61a4d7-422b-4728-825f-7a370b43b2ec-kube-api-access-lbmxw\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.433154 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.433137    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m42hf_76e63fa6-26d3-4247-96ff-15abbb584b6a/dns-node-resolver/0.log"
Oct 30 10:45:24.456363 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.456327    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.456457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.456369    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61a4d7-422b-4728-825f-7a370b43b2ec-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.456457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.456407    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmxw\" (UniqueName: \"kubernetes.io/projected/9a61a4d7-422b-4728-825f-7a370b43b2ec-kube-api-access-lbmxw\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.456563 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.456512    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.456962 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.456940    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61a4d7-422b-4728-825f-7a370b43b2ec-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.458652 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.458632    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.458652 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.458644    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a61a4d7-422b-4728-825f-7a370b43b2ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.480973 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.480928    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmxw\" (UniqueName: \"kubernetes.io/projected/9a61a4d7-422b-4728-825f-7a370b43b2ec-kube-api-access-lbmxw\") pod \"prometheus-operator-9cd89b74c-hrf4f\" (UID: \"9a61a4d7-422b-4728-825f-7a370b43b2ec\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.532778 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.532754    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"
Oct 30 10:45:24.824125 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.824098    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f"]
Oct 30 10:45:24.825249 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:24.825220    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a61a4d7_422b_4728_825f_7a370b43b2ec.slice/crio-87e2de320ef437b60f5984fec425bfd0691aa9c9a7948d32a12ed4ef0f9b6a77 WatchSource:0}: Error finding container 87e2de320ef437b60f5984fec425bfd0691aa9c9a7948d32a12ed4ef0f9b6a77: Status 404 returned error can't find the container with id 87e2de320ef437b60f5984fec425bfd0691aa9c9a7948d32a12ed4ef0f9b6a77
Oct 30 10:45:24.941017 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:24.940990    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f" event={"ID":"9a61a4d7-422b-4728-825f-7a370b43b2ec","Type":"ContainerStarted","Data":"87e2de320ef437b60f5984fec425bfd0691aa9c9a7948d32a12ed4ef0f9b6a77"}
Oct 30 10:45:25.232786 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:25.232765    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pzbfk_0eabd736-4d90-410f-bc80-ff82deb9f1d4/node-ca/0.log"
Oct 30 10:45:26.432294 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:26.432268    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mk6zq_e09c17dd-ed06-461b-9cdc-d2ad16557bbc/serve-healthcheck-canary/0.log"
Oct 30 10:45:26.632748 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:26.632723    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-hltqq_a9a0f6a2-4aba-4fb6-9fce-fb02a50d0d0b/migrator/0.log"
Oct 30 10:45:26.949600 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:26.949566    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f" event={"ID":"9a61a4d7-422b-4728-825f-7a370b43b2ec","Type":"ContainerStarted","Data":"4d64b7c0fc171852d8aae262c82644004f9f2259d47474b073b2e083f0dcf997"}
Oct 30 10:45:26.949786 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:26.949616    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f" event={"ID":"9a61a4d7-422b-4728-825f-7a370b43b2ec","Type":"ContainerStarted","Data":"7ca6cd223192fa9ea17f8bfdbbe34ba205417edb43e81a687fed5fdc89c76a2e"}
Oct 30 10:45:26.997053 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:26.997009    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-hrf4f" podStartSLOduration=1.8353929500000001 podStartE2EDuration="2.996996591s" totalImagesPullingTime="1.161603641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:26.996690017 +0000 UTC m=+23.342281871" watchObservedRunningTime="2026-10-30 10:45:26.996996591 +0000 UTC m=+23.342588444"
Oct 30 10:45:28.821294 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.821260    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"]
Oct 30 10:45:28.825247 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.825228    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.847562 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.847532    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6fp27"]
Oct 30 10:45:28.850362 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.850327    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.861736 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.861716    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"]
Oct 30 10:45:28.895236 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895211    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 10:45:28.895634 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895614    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 10:45:28.895733 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895716    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jgh82\""
Oct 30 10:45:28.895778 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895773    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srphb\""
Oct 30 10:45:28.895854 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895844    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 10:45:28.895940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.895930    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 10:45:28.906984 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.906961    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 10:45:28.907062 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.907046    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 10:45:28.986083 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986056    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-metrics-client-ca\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986083 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986084    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4dsj\" (UniqueName: \"kubernetes.io/projected/380d1ab7-6b27-467f-b125-32670d5604e5-kube-api-access-z4dsj\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986248 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986107    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsq8g\" (UniqueName: \"kubernetes.io/projected/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-api-access-tsq8g\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986248 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986161    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-root\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986248 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986200    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-sys\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986248 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986233    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-wtmp\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986292    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986322    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986408    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986430    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986519 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986460    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986519 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986495    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986581 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986542    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:28.986581 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986573    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-tls\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:28.986640 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:28.986593    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-textfile\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087660 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087592    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.087660 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087629    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087660    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087694    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-tls\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087723    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-textfile\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087757    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-metrics-client-ca\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087781    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4dsj\" (UniqueName: \"kubernetes.io/projected/380d1ab7-6b27-467f-b125-32670d5604e5-kube-api-access-z4dsj\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087815    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsq8g\" (UniqueName: \"kubernetes.io/projected/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-api-access-tsq8g\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.087856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087852    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-root\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087877    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-sys\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087901    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-wtmp\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087933    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.087962    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088002    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088028    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088107    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-sys\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088363    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-root\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088607    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088704    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088756    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-wtmp\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088942    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-metrics-client-ca\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.088953    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.089170    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-textfile\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.089319 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.089293    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.090477 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.090440    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.090872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.090843    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.091189 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.091172    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/380d1ab7-6b27-467f-b125-32670d5604e5-node-exporter-tls\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.091683 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.091662    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.112731 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.112706    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4dsj\" (UniqueName: \"kubernetes.io/projected/380d1ab7-6b27-467f-b125-32670d5604e5-kube-api-access-z4dsj\") pod \"node-exporter-6fp27\" (UID: \"380d1ab7-6b27-467f-b125-32670d5604e5\") " pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.112859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.112841    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsq8g\" (UniqueName: \"kubernetes.io/projected/c870f68c-3566-4fd5-bf67-7ac91ea4d8e9-kube-api-access-tsq8g\") pod \"kube-state-metrics-5dc8d7d89b-8fnmk\" (UID: \"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.138644 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.138621    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"
Oct 30 10:45:29.166929 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.166904    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6fp27"
Oct 30 10:45:29.178107 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:29.178079    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380d1ab7_6b27_467f_b125_32670d5604e5.slice/crio-6100a4b43ae23b23e3bc15b7f04e80b2f4525990677213c661085ef0574cd99e WatchSource:0}: Error finding container 6100a4b43ae23b23e3bc15b7f04e80b2f4525990677213c661085ef0574cd99e: Status 404 returned error can't find the container with id 6100a4b43ae23b23e3bc15b7f04e80b2f4525990677213c661085ef0574cd99e
Oct 30 10:45:29.449058 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.449034    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk"]
Oct 30 10:45:29.450021 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:29.449995    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc870f68c_3566_4fd5_bf67_7ac91ea4d8e9.slice/crio-32361dcdd19cefca730bc144260a638bcdaa5d94bd88ab71ea735ef98900d142 WatchSource:0}: Error finding container 32361dcdd19cefca730bc144260a638bcdaa5d94bd88ab71ea735ef98900d142: Status 404 returned error can't find the container with id 32361dcdd19cefca730bc144260a638bcdaa5d94bd88ab71ea735ef98900d142
Oct 30 10:45:29.960936 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.960900    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6fp27" event={"ID":"380d1ab7-6b27-467f-b125-32670d5604e5","Type":"ContainerStarted","Data":"6100a4b43ae23b23e3bc15b7f04e80b2f4525990677213c661085ef0574cd99e"}
Oct 30 10:45:29.962567 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:29.962534    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk" event={"ID":"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9","Type":"ContainerStarted","Data":"32361dcdd19cefca730bc144260a638bcdaa5d94bd88ab71ea735ef98900d142"}
Oct 30 10:45:30.183391 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.183366    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:45:30.187252 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.187232    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.204489 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204468    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 10:45:30.204489 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204479    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 10:45:30.204681 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204664    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-st4hs\""
Oct 30 10:45:30.204681 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204675    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 10:45:30.204837 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204664    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 10:45:30.204837 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204703    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 10:45:30.204837 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204755    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 10:45:30.204987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.204865    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 10:45:30.218309 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.218261    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 10:45:30.219676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.219654    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:45:30.299619 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299591    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299636    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299658    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299673    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299760 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299722    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299902 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299776    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299902 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299796    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299902 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299816    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrhf\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.299902 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299858    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.300033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299915    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.300033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299934    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.300033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299953    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.300033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.299970    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.304470 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.304445    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 10:45:30.400446 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.400417    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.400446 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.400450    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.400674 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.400475    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.400674 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.400531    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.400674 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.400605    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401159 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401134    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401264 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401218    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401264 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401227    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401398 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401273    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401398 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401300    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401398 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401325    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401398 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401381    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401588 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401412    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401588 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401447    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrhf\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.401588 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401545    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.402025 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.401991    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.404254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.404204    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.404799 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.404722    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.404799 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.404731    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.404960 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.404931    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.405382 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.405312    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.406094 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.406062    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.406191 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.406100    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.406191 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.406147    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.406329 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.406304    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.427358 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.427313    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrhf\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\") pod \"alertmanager-main-0\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.553699 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.553623    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:45:30.890299 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.890276    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:45:30.891921 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:45:30.891895    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b72623_6f8b_43de_b213_ff14c170cbe3.slice/crio-db2a0a9d07e7eaffc9fec67169569d1097b2e9968d0b939f83e7fcb60694c652 WatchSource:0}: Error finding container db2a0a9d07e7eaffc9fec67169569d1097b2e9968d0b939f83e7fcb60694c652: Status 404 returned error can't find the container with id db2a0a9d07e7eaffc9fec67169569d1097b2e9968d0b939f83e7fcb60694c652
Oct 30 10:45:30.969147 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.969106    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk" event={"ID":"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9","Type":"ContainerStarted","Data":"1df2583acdad070c4790c252d8296ee85c666ef1370877316ba6c96fad7c41ab"}
Oct 30 10:45:30.969648 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.969197    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk" event={"ID":"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9","Type":"ContainerStarted","Data":"248c5a29fcbc06ba44f576e7a8e38c921d67a2cce7028fea19eb339e4f9ad7e4"}
Oct 30 10:45:30.969648 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.969231    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk" event={"ID":"c870f68c-3566-4fd5-bf67-7ac91ea4d8e9","Type":"ContainerStarted","Data":"b117cd9738962a59258c6066edaa598e982626b6d8b5a14a4908ebb199f2b653"}
Oct 30 10:45:30.970854 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.970544    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"db2a0a9d07e7eaffc9fec67169569d1097b2e9968d0b939f83e7fcb60694c652"}
Oct 30 10:45:30.972469 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.972441    4488 generic.go:356] "Generic (PLEG): container finished" podID="380d1ab7-6b27-467f-b125-32670d5604e5" containerID="27ec937e9c2250bae2310bbabe4d8f270cef2e5b7196f1887db2d283530ca368" exitCode=0
Oct 30 10:45:30.972564 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:30.972503    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6fp27" event={"ID":"380d1ab7-6b27-467f-b125-32670d5604e5","Type":"ContainerDied","Data":"27ec937e9c2250bae2310bbabe4d8f270cef2e5b7196f1887db2d283530ca368"}
Oct 30 10:45:31.016986 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:31.016935    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8fnmk" podStartSLOduration=1.804268523 podStartE2EDuration="3.016916016s" totalImagesPullingTime="1.212647493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:31.01562545 +0000 UTC m=+27.361217304" watchObservedRunningTime="2026-10-30 10:45:31.016916016 +0000 UTC m=+27.362507872"
Oct 30 10:45:31.483177 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:45:31.483137    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:45:31.980764 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:31.980736    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6fp27" event={"ID":"380d1ab7-6b27-467f-b125-32670d5604e5","Type":"ContainerStarted","Data":"1fccfe708983875db1da20687a52cf5b6b29d7b802ed28e9ac16ffa01a522089"}
Oct 30 10:45:31.981059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:31.980796    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6fp27" event={"ID":"380d1ab7-6b27-467f-b125-32670d5604e5","Type":"ContainerStarted","Data":"091a7b1daa1dc0f3d1a68110a837e95c79335c8d9c3a2810663cac6a80947b92"}
Oct 30 10:45:32.031311 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:32.031266    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6fp27" podStartSLOduration=3.102544596 podStartE2EDuration="4.031253096s" totalImagesPullingTime="853.87608ms" totalInitContainerRuntime="74.83242ms" isStatefulPod=true podCreationTimestamp="2026-10-30 10:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:32.030641725 +0000 UTC m=+28.376233620" watchObservedRunningTime="2026-10-30 10:45:32.031253096 +0000 UTC m=+28.376844949"
Oct 30 10:45:32.985870 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:32.985832    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0" exitCode=0
Oct 30 10:45:32.986245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:32.985916    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0"}
Oct 30 10:45:34.994964 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:34.994942    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"}
Oct 30 10:45:35.697586 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.697412    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:45:35.711472 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.711443    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.729688 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.729601    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:45:35.742505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742477    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 10:45:35.742646 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742628    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.742750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742652    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 10:45:35.742750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742666    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.742750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742704    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.742750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742734    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbmf6\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.742964 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742775    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 10:45:35.742964 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742817    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 10:45:35.742964 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742866    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 10:45:35.743107 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742995    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 10:45:35.743107 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743022    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 10:45:35.743200 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743125    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743200 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743137    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 10:45:35.743200 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743182    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743200 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.742479    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 10:45:35.743413 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743253    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743413 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743290    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743413 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743294    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-hs0dccberl7e\""
Oct 30 10:45:35.743413 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743376    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743599 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743461    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743599 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743541    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743692 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743613    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743692 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743644    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743785 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743754    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743791    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743822    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743941 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743853    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.743941 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743892    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.744019 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.743939    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.744019 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.744005    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.744216 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.744176    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 10:45:35.744216 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.744184    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 10:45:35.744216 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.744180    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vkdsr\""
Oct 30 10:45:35.760650 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.758494    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 10:45:35.760650 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.758658    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 10:45:35.760809 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.760727    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 10:45:35.771763 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.771745    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 10:45:35.844867 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844841    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844877    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844900    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844922    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844941    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbmf6\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844957    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.844981    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845003    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845024    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845052    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845081    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845118    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845145    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845175    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845205    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845244    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845269    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845297    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845363    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.845407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845403    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.846006 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845533    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.846006 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845675    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.846006 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.845985    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.846006 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.846014    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.846238 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.846032    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.848131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848107    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.848237 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848198    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848319    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848450    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848892    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848969    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.848984    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849425 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.849399    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849834 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.849810    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.849946 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.849926    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.850283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.850258    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.850611 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.850592    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.851335 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.851317    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.851546 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.851529    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:35.869807 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:35.869787    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbmf6\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\") pod \"prometheus-k8s-0\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:36.002537 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.002460    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"}
Oct 30 10:45:36.002987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.002540    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"}
Oct 30 10:45:36.002987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.002577    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"}
Oct 30 10:45:36.002987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.002612    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"}
Oct 30 10:45:36.121857 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.121822    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:36.472399 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:36.472374    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:45:37.008930 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:37.008902    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerStarted","Data":"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"}
Oct 30 10:45:37.010649 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:37.010625    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9" exitCode=0
Oct 30 10:45:37.010758 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:37.010679    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"}
Oct 30 10:45:37.010758 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:37.010722    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"db55037ede0859738534b5a6e0da8ddce411af76e09ae226a6a4cc2869108c49"}
Oct 30 10:45:37.066211 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:37.066171    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.197011186 podStartE2EDuration="7.06615749s" totalImagesPullingTime="3.850967445s" totalInitContainerRuntime="18.178859ms" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:37.065136937 +0000 UTC m=+33.410728791" watchObservedRunningTime="2026-10-30 10:45:37.06615749 +0000 UTC m=+33.411749344"
Oct 30 10:45:38.756672 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:38.756635    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tvvbs"
Oct 30 10:45:41.034276 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:41.034235    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"}
Oct 30 10:45:41.034746 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:41.034325    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"}
Oct 30 10:45:42.052479 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:42.052452    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"}
Oct 30 10:45:42.052870 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:42.052516    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"}
Oct 30 10:45:42.052870 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:42.052547    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"}
Oct 30 10:45:43.059893 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:43.059853    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerStarted","Data":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"}
Oct 30 10:45:46.122246 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:46.122213    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:51.934814 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:51.934764    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.261973433 podStartE2EDuration="16.934746602s" totalImagesPullingTime="4.660146379s" totalInitContainerRuntime="12.62679ms" isStatefulPod=false podCreationTimestamp="2026-10-30 10:45:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:45:43.142946144 +0000 UTC m=+39.488537999" watchObservedRunningTime="2026-10-30 10:45:51.934746602 +0000 UTC m=+48.280338450"
Oct 30 10:45:51.935294 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:51.935276    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:45:51.935732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:51.935710    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" podUID="374b9fb3-2f09-480d-8524-d33ea5e0a447" containerName="insights-gathering" containerID="cri-o://bb8648631237bc10664ad409f36ca9e6d4e05641f58474d2e2754a8ddc9f85de" gracePeriod=30
Oct 30 10:45:52.093156 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.093116    4488 generic.go:356] "Generic (PLEG): container finished" podID="374b9fb3-2f09-480d-8524-d33ea5e0a447" containerID="bb8648631237bc10664ad409f36ca9e6d4e05641f58474d2e2754a8ddc9f85de" exitCode=2
Oct 30 10:45:52.093288 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.093190    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" event={"ID":"374b9fb3-2f09-480d-8524-d33ea5e0a447","Type":"ContainerDied","Data":"bb8648631237bc10664ad409f36ca9e6d4e05641f58474d2e2754a8ddc9f85de"}
Oct 30 10:45:52.186283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.186232    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:52.287070 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287040    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") pod \"374b9fb3-2f09-480d-8524-d33ea5e0a447\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") "
Oct 30 10:45:52.287228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287093    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") pod \"374b9fb3-2f09-480d-8524-d33ea5e0a447\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") "
Oct 30 10:45:52.287228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287112    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") pod \"374b9fb3-2f09-480d-8524-d33ea5e0a447\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") "
Oct 30 10:45:52.287228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287141    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") pod \"374b9fb3-2f09-480d-8524-d33ea5e0a447\" (UID: \"374b9fb3-2f09-480d-8524-d33ea5e0a447\") "
Oct 30 10:45:52.287431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287410    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path" pod "374b9fb3-2f09-480d-8524-d33ea5e0a447" (UID: "374b9fb3-2f09-480d-8524-d33ea5e0a447"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:45:52.287494 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287469    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle" pod "374b9fb3-2f09-480d-8524-d33ea5e0a447" (UID: "374b9fb3-2f09-480d-8524-d33ea5e0a447"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:45:52.287494 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.287478    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle" pod "374b9fb3-2f09-480d-8524-d33ea5e0a447" (UID: "374b9fb3-2f09-480d-8524-d33ea5e0a447"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:45:52.289413 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.289380    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j" pod "374b9fb3-2f09-480d-8524-d33ea5e0a447" (UID: "374b9fb3-2f09-480d-8524-d33ea5e0a447"). InnerVolumeSpecName "kube-api-access-lcm8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:45:52.388245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.388219    4488 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-service-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:45:52.388245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.388241    4488 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/374b9fb3-2f09-480d-8524-d33ea5e0a447-archives-path\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:45:52.388402 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.388250    4488 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374b9fb3-2f09-480d-8524-d33ea5e0a447-trusted-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:45:52.388402 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:52.388259    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcm8j\" (UniqueName: \"kubernetes.io/projected/374b9fb3-2f09-480d-8524-d33ea5e0a447-kube-api-access-lcm8j\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:45:53.098318 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.098288    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk"
Oct 30 10:45:53.098318 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.098299    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-nnxpr-ffxxk" event={"ID":"374b9fb3-2f09-480d-8524-d33ea5e0a447","Type":"ContainerDied","Data":"bf14f63401347c3c24a8a9a05693f4d2b0af2f9794479b65c56d12285ce1d871"}
Oct 30 10:45:53.098818 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.098379    4488 scope.go:122] "RemoveContainer" containerID="bb8648631237bc10664ad409f36ca9e6d4e05641f58474d2e2754a8ddc9f85de"
Oct 30 10:45:53.153505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.153483    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:45:53.164055 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.164033    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-nnxpr-ffxxk"]
Oct 30 10:45:53.633375 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.633337    4488 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:53.651060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.651040    4488 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:45:53.801647 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:53.801617    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="374b9fb3-2f09-480d-8524-d33ea5e0a447" path="/var/lib/kubelet/pods/374b9fb3-2f09-480d-8524-d33ea5e0a447/volumes"
Oct 30 10:45:54.117094 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:45:54.117067    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:01.478278 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:01.478243    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:46:19.364506 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364473    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364753    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="alertmanager" containerID="cri-o://3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1" gracePeriod=120
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364770    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="prom-label-proxy" containerID="cri-o://b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4" gracePeriod=120
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364774    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy" containerID="cri-o://bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594" gracePeriod=120
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364813    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-web" containerID="cri-o://901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da" gracePeriod=120
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364842    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="config-reloader" containerID="cri-o://09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179" gracePeriod=120
Oct 30 10:46:19.365013 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:19.364842    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-metric" containerID="cri-o://b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251" gracePeriod=120
Oct 30 10:46:20.196676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196641    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4" exitCode=0
Oct 30 10:46:20.196676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196665    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594" exitCode=0
Oct 30 10:46:20.196676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196674    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da" exitCode=0
Oct 30 10:46:20.196676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196681    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179" exitCode=0
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196689    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1" exitCode=0
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196708    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"}
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196769    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"}
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196794    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"}
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196818    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"}
Oct 30 10:46:20.196940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.196849    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"}
Oct 30 10:46:20.606276 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.606253    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:20.693722 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693701    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.693840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693737    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.693840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693761    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.693840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693781    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.693840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693800    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.693840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693819    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694092 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693924    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694092 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.693980    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694092 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694031    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694092 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694080    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694113    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694166    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:46:20.694296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694188    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694211    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:20.694296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694244    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\") pod \"f7b72623-6f8b-43de-b213-ff14c170cbe3\" (UID: \"f7b72623-6f8b-43de-b213-ff14c170cbe3\") "
Oct 30 10:46:20.694833 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.694588    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:20.695372 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.695330    4488 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-main-db\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.695537 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.695519    4488 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.695669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.695655    4488 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b72623-6f8b-43de-b213-ff14c170cbe3-metrics-client-ca\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.696525 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.696493    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.696827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.696802    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "kube-api-access-mjrhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:46:20.696936 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.696837    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.696936 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.696922    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.697061 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.696947    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.697301 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.697273    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:46:20.697301 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.697289    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:46:20.698165 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.698143    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.702885 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.702703    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.709966 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.709941    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config" pod "f7b72623-6f8b-43de-b213-ff14c170cbe3" (UID: "f7b72623-6f8b-43de-b213-ff14c170cbe3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:20.796713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796656    4488 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-tls-assets\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796678    4488 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-out\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796687    4488 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-config-volume\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796697    4488 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796707    4488 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796931 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796718    4488 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-cluster-tls-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796931 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796726    4488 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796931 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796735    4488 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-web-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796931 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796745    4488 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7b72623-6f8b-43de-b213-ff14c170cbe3-secret-alertmanager-main-tls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:20.796931 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:20.796752    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjrhf\" (UniqueName: \"kubernetes.io/projected/f7b72623-6f8b-43de-b213-ff14c170cbe3-kube-api-access-mjrhf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:21.203422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.203391    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerID="b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251" exitCode=0
Oct 30 10:46:21.203568 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.203468    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.203568 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.203466    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"}
Oct 30 10:46:21.203568 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.203533    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7b72623-6f8b-43de-b213-ff14c170cbe3","Type":"ContainerDied","Data":"db2a0a9d07e7eaffc9fec67169569d1097b2e9968d0b939f83e7fcb60694c652"}
Oct 30 10:46:21.203670 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.203567    4488 scope.go:122] "RemoveContainer" containerID="b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"
Oct 30 10:46:21.211687 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.211656    4488 scope.go:122] "RemoveContainer" containerID="b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"
Oct 30 10:46:21.219195 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.219178    4488 scope.go:122] "RemoveContainer" containerID="bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"
Oct 30 10:46:21.225278 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.225260    4488 scope.go:122] "RemoveContainer" containerID="901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"
Oct 30 10:46:21.231361 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.231328    4488 scope.go:122] "RemoveContainer" containerID="09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"
Oct 30 10:46:21.237827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.237810    4488 scope.go:122] "RemoveContainer" containerID="3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"
Oct 30 10:46:21.244163 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.244148    4488 scope.go:122] "RemoveContainer" containerID="e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0"
Oct 30 10:46:21.250300 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.250287    4488 scope.go:122] "RemoveContainer" containerID="b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"
Oct 30 10:46:21.250609 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.250590    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4\": container with ID starting with b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4 not found: ID does not exist" containerID="b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"
Oct 30 10:46:21.250661 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.250616    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4"} err="failed to get container status \"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4\": rpc error: code = NotFound desc = could not find container \"b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4\": container with ID starting with b6f70e1fe76a5a788743951efbbc1b4028e066d0d937f277743ec86b30b409b4 not found: ID does not exist"
Oct 30 10:46:21.250661 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.250645    4488 scope.go:122] "RemoveContainer" containerID="b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"
Oct 30 10:46:21.250877 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.250860    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251\": container with ID starting with b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251 not found: ID does not exist" containerID="b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"
Oct 30 10:46:21.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.250884    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251"} err="failed to get container status \"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251\": rpc error: code = NotFound desc = could not find container \"b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251\": container with ID starting with b4de3c5c024e49ace31a684aa65f6906c9934a6447ccd7516bce6ca08b422251 not found: ID does not exist"
Oct 30 10:46:21.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.250899    4488 scope.go:122] "RemoveContainer" containerID="bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"
Oct 30 10:46:21.251116 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.251099    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594\": container with ID starting with bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594 not found: ID does not exist" containerID="bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"
Oct 30 10:46:21.251158 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251123    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594"} err="failed to get container status \"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594\": rpc error: code = NotFound desc = could not find container \"bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594\": container with ID starting with bba772fa3617c223650594a4ff97c568f8d73a040c7fb62bfc05b9b4fed36594 not found: ID does not exist"
Oct 30 10:46:21.251158 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251139    4488 scope.go:122] "RemoveContainer" containerID="901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"
Oct 30 10:46:21.251378 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.251361    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da\": container with ID starting with 901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da not found: ID does not exist" containerID="901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"
Oct 30 10:46:21.251424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251382    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da"} err="failed to get container status \"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da\": rpc error: code = NotFound desc = could not find container \"901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da\": container with ID starting with 901518d88c69003c16061e654f46ce87efe6a44cbb89383debc839153021d7da not found: ID does not exist"
Oct 30 10:46:21.251424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251397    4488 scope.go:122] "RemoveContainer" containerID="09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"
Oct 30 10:46:21.251648 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.251633    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179\": container with ID starting with 09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179 not found: ID does not exist" containerID="09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"
Oct 30 10:46:21.251685 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251652    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179"} err="failed to get container status \"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179\": rpc error: code = NotFound desc = could not find container \"09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179\": container with ID starting with 09733fea6b60652a37439308a8ddaf45582906a7e9a24e0366511d1b32445179 not found: ID does not exist"
Oct 30 10:46:21.251685 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251663    4488 scope.go:122] "RemoveContainer" containerID="3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"
Oct 30 10:46:21.251886 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.251870    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1\": container with ID starting with 3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1 not found: ID does not exist" containerID="3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"
Oct 30 10:46:21.251935 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251890    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1"} err="failed to get container status \"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1\": rpc error: code = NotFound desc = could not find container \"3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1\": container with ID starting with 3f01b2f4f4c9223bacc8c2a8e423c4649f7e4adcbd595f53303c27259a2ba9c1 not found: ID does not exist"
Oct 30 10:46:21.251935 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.251903    4488 scope.go:122] "RemoveContainer" containerID="e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0"
Oct 30 10:46:21.252142 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:21.252124    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0\": container with ID starting with e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0 not found: ID does not exist" containerID="e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0"
Oct 30 10:46:21.252183 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.252149    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0"} err="failed to get container status \"e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0\": rpc error: code = NotFound desc = could not find container \"e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0\": container with ID starting with e069832182b8aad86233d9b6946a10da4e151c8ee27a2c35c8ee244c930a93d0 not found: ID does not exist"
Oct 30 10:46:21.276795 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.276775    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:21.291417 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.291397    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:21.312075 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312058    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:21.312301 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312290    4488 cpu_manager.go:414] "containerMap: removing container" podUID="374b9fb3-2f09-480d-8524-d33ea5e0a447" containerName="insights-gathering"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312302    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="374b9fb3-2f09-480d-8524-d33ea5e0a447" containerName="insights-gathering"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312312    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-metric"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312318    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-metric"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312327    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="init-config-reloader"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312332    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="init-config-reloader"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312353    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="config-reloader"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312358    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="config-reloader"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312365    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-web"
Oct 30 10:46:21.312367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312369    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-web"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312375    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="prom-label-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312379    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="prom-label-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312386    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312390    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312408    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="alertmanager"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312412    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="alertmanager"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312452    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="374b9fb3-2f09-480d-8524-d33ea5e0a447" containerName="insights-gathering"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312459    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-metric"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312466    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="config-reloader"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312472    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy-web"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312478    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="prom-label-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312483    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="kube-rbac-proxy"
Oct 30 10:46:21.312669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.312491    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" containerName="alertmanager"
Oct 30 10:46:21.317449 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.317434    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.334703 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.334676    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 10:46:21.334816 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.334710    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 10:46:21.334816 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.334718    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 10:46:21.334816 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.334760    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 10:46:21.335005 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.334978    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 10:46:21.335082 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.335012    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 10:46:21.335082 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.335014    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 10:46:21.335199 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.335041    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 10:46:21.335368 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.335328    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-st4hs\""
Oct 30 10:46:21.349411 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.349390    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 10:46:21.350526 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.350504    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:21.400446 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400421    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400532 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400454    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400532 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400474    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400532 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400491    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400644 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400595    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-web-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400644 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400619    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400644 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400640    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-config-out\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400733 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400657    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400783 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400768    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400818 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400793    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400847 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400817    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400867    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.400917 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.400893    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb6q9\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-kube-api-access-fb6q9\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.501784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501762    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.501872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501792    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.501872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501819    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.501872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501845    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb6q9\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-kube-api-access-fb6q9\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.501872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501870    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502074 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.501901    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502074 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502019    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502172 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502078    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502173    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-web-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502287 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502266    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502364 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502324    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-config-out\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502445 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502370    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502445 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502421    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.502796 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502774    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.503242 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.502937    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b08ff0-69bd-4288-b9d9-b64326829458-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.503242 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.503076    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.504906 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.504862    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.504906 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.504890    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505132    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505246 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505169    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505591 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505564    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505665 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505600    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-web-config\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505716 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505695    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5b08ff0-69bd-4288-b9d9-b64326829458-config-out\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.505883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.505863    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.506515 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.506496    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5b08ff0-69bd-4288-b9d9-b64326829458-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.527023 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.527003    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb6q9\" (UniqueName: \"kubernetes.io/projected/e5b08ff0-69bd-4288-b9d9-b64326829458-kube-api-access-fb6q9\") pod \"alertmanager-main-0\" (UID: \"e5b08ff0-69bd-4288-b9d9-b64326829458\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.641378 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.641356    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 10:46:21.802735 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.802678    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7b72623-6f8b-43de-b213-ff14c170cbe3" path="/var/lib/kubelet/pods/f7b72623-6f8b-43de-b213-ff14c170cbe3/volumes"
Oct 30 10:46:21.988557 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:46:21.988529    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b08ff0_69bd_4288_b9d9_b64326829458.slice/crio-8999117b73dda155798e07e29d3a41bf4d89a4abfcdc51f92a87e8b4fc459c48 WatchSource:0}: Error finding container 8999117b73dda155798e07e29d3a41bf4d89a4abfcdc51f92a87e8b4fc459c48: Status 404 returned error can't find the container with id 8999117b73dda155798e07e29d3a41bf4d89a4abfcdc51f92a87e8b4fc459c48
Oct 30 10:46:21.988694 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:21.988630    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 10:46:22.208180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:22.208151    4488 generic.go:356] "Generic (PLEG): container finished" podID="e5b08ff0-69bd-4288-b9d9-b64326829458" containerID="5ccc70429494392601a1da37ed385030bf9cd8980b79625022973cf68ce04198" exitCode=0
Oct 30 10:46:22.208287 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:22.208190    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerDied","Data":"5ccc70429494392601a1da37ed385030bf9cd8980b79625022973cf68ce04198"}
Oct 30 10:46:22.208287 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:22.208262    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"8999117b73dda155798e07e29d3a41bf4d89a4abfcdc51f92a87e8b4fc459c48"}
Oct 30 10:46:23.222799 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222766    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"f26e9ecfa5964d0dddfff37e158ec8df7b24369ef381103e93bce1533fa9b497"}
Oct 30 10:46:23.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222861    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"8803fc8c0c46d5434bd2695b1a2719631e9938b3b9039064a5d7918ec9ab9d47"}
Oct 30 10:46:23.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222888    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"35ac413b473ca8dcf848b7780f04f34dc059c8095378439bfb2750f0dfa1d6ac"}
Oct 30 10:46:23.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222912    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"e0a12d5980517617e03f2df8ff8233c046802e9c88b750b4c5520b7f1fef0f57"}
Oct 30 10:46:23.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222938    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"99c0c02b1beed879a5c66256f0ee93f17e8ec039dcb00b93f3b6af2aa83f45af"}
Oct 30 10:46:23.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.222964    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5b08ff0-69bd-4288-b9d9-b64326829458","Type":"ContainerStarted","Data":"8fcde69563472c809fcac141729224198acb98c8de12ac488c9bda8bcb2dd816"}
Oct 30 10:46:23.323469 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.323414    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.31411738 podStartE2EDuration="2.323397362s" totalImagesPullingTime="0s" totalInitContainerRuntime="9.279982ms" isStatefulPod=false podCreationTimestamp="2026-10-30 10:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:46:23.308473727 +0000 UTC m=+79.654065581" watchObservedRunningTime="2026-10-30 10:46:23.323397362 +0000 UTC m=+79.668989217"
Oct 30 10:46:23.954355 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954314    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:23.954796 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954733    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="thanos-sidecar" containerID="cri-o://16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0" gracePeriod=600
Oct 30 10:46:23.954796 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954754    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="prometheus" containerID="cri-o://92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb" gracePeriod=600
Oct 30 10:46:23.954796 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954750    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy" containerID="cri-o://65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d" gracePeriod=600
Oct 30 10:46:23.954998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954730    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0" gracePeriod=600
Oct 30 10:46:23.954998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.954758    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-web" containerID="cri-o://642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f" gracePeriod=600
Oct 30 10:46:23.955731 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:23.955445    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="config-reloader" containerID="cri-o://af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c" gracePeriod=600
Oct 30 10:46:24.102901 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.102864    4488 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 10:46:24.103053 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.102918    4488 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 10:46:24.103053 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.102940    4488 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 10:46:24.103053 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.102954    4488 prober.go:106] "Probe errored" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="prometheus" probeResult="unknown" err="rpc error: code = Canceled desc = context canceled"
Oct 30 10:46:24.204088 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.204059    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234691    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0" exitCode=0
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234719    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d" exitCode=0
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234725    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f" exitCode=0
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234732    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0" exitCode=0
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234737    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c" exitCode=0
Oct 30 10:46:24.234756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234742    4488 generic.go:356] "Generic (PLEG): container finished" podID="75eec311-08dc-41bc-8028-f4aed74e21af" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb" exitCode=0
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234775    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234794    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234871    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234900    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234926    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234948    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234969    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.234992    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75eec311-08dc-41bc-8028-f4aed74e21af","Type":"ContainerDied","Data":"db55037ede0859738534b5a6e0da8ddce411af76e09ae226a6a4cc2869108c49"}
Oct 30 10:46:24.235431 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.235020    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.245944 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.245913    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.253131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.253108    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.259672 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.259646    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.267427 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.267404    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.274991 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.274972    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.283224 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.283193    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.291647 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.291630    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.291911 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.291894    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.291979 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.291921    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.291979 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.291945    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.292209 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.292190    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.292247 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292215    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.292247 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292230    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.292464 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.292449    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.292513 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292466    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.292513 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292477    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.292736 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.292722    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.292775 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292737    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.292775 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292748    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.292950 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.292935    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.292998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292954    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.292998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.292966    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.293169 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.293139    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.293245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293179    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.293245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293199    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.293449 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:24.293434    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.293494 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293452    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.293494 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293464    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.293742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293714    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.293822 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293743    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.293953 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293931    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.293953 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.293950    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.294171 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294155    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.294171 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294170    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.294372 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294335    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.294425 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294372    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.294612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294590    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.294612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294611    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.294836 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294815    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.294884 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.294836    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.295036 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295015    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.295036 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295036    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.295280 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295260    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.295366 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295282    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.295565 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295545    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.295626 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295567    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.295827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295807    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.295827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.295825    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.296034 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296016    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.296104 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296035    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.296245 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296228    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.296312 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296246    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.296505 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296489    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.296575 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296506    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.296718 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296702    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.296784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296718    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.296940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296923    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.297004 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.296942    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.297182 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297154    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.297225 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297184    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.297422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297397    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.297422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297422    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.297662 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297644    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.297719 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297663    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.297928 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297910    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.297989 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.297928    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.298206 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298188    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.298257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298208    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.298457 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298440    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.298527 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298458    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.298676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298647    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.298676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298669    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.298924 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298906    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.298969 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.298925    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.299137 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299117    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.299195 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299141    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.299380 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299360    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.299458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299381    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.299676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299659    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.299747 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299677    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.299922 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299905    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.299998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.299922    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.300125 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300107    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.300173 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300125    4488 scope.go:122] "RemoveContainer" containerID="a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"
Oct 30 10:46:24.300320 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300306    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0"} err="failed to get container status \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": rpc error: code = NotFound desc = could not find container \"a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0\": container with ID starting with a44e57390c12dc05634f2890b2a57af01965423dc6ed52ca2315447a9548daa0 not found: ID does not exist"
Oct 30 10:46:24.300380 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300320    4488 scope.go:122] "RemoveContainer" containerID="65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"
Oct 30 10:46:24.300572 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300555    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d"} err="failed to get container status \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": rpc error: code = NotFound desc = could not find container \"65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d\": container with ID starting with 65364e0816e0233a958f330ef5806f664051d0be77ebeae3be8f8841f975d97d not found: ID does not exist"
Oct 30 10:46:24.300642 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300574    4488 scope.go:122] "RemoveContainer" containerID="642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"
Oct 30 10:46:24.300839 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300820    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f"} err="failed to get container status \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": rpc error: code = NotFound desc = could not find container \"642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f\": container with ID starting with 642e0195bb1a4c22fa4fb619bdf24d2ce073aab278369813407f6c29badf0b5f not found: ID does not exist"
Oct 30 10:46:24.300895 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.300840    4488 scope.go:122] "RemoveContainer" containerID="16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"
Oct 30 10:46:24.301052 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301032    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0"} err="failed to get container status \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": rpc error: code = NotFound desc = could not find container \"16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0\": container with ID starting with 16d42ce410f81f25a6dc38889be65fe1c59f443a0977e8cb6191eeaba7982da0 not found: ID does not exist"
Oct 30 10:46:24.301100 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301053    4488 scope.go:122] "RemoveContainer" containerID="af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"
Oct 30 10:46:24.301299 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301280    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c"} err="failed to get container status \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": rpc error: code = NotFound desc = could not find container \"af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c\": container with ID starting with af8afbd337f8726aae4d08f82ae601471fa5e574a10b92920b910f3e8a1e2f4c not found: ID does not exist"
Oct 30 10:46:24.301336 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301301    4488 scope.go:122] "RemoveContainer" containerID="92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"
Oct 30 10:46:24.301579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301563    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb"} err="failed to get container status \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": rpc error: code = NotFound desc = could not find container \"92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb\": container with ID starting with 92fc101ebcc35f13c3e5a431cadbe3be68ea56bce814313fefb840a09f19d1eb not found: ID does not exist"
Oct 30 10:46:24.301643 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301580    4488 scope.go:122] "RemoveContainer" containerID="bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"
Oct 30 10:46:24.301799 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.301784    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9"} err="failed to get container status \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": rpc error: code = NotFound desc = could not find container \"bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9\": container with ID starting with bc8f2ebaa4681cf84eb6fd7887828f4119edd059f63970df90a7b2d452c082d9 not found: ID does not exist"
Oct 30 10:46:24.324068 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324047    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324155 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324079    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324155 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324103    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324155 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324145    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324313 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324186    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324313 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324218    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324313 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324269    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324313 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324305    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324337    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324409    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324437    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324494    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324579 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324501    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324531    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324652    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324690    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324719    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324759    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324791    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.324827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324821    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.325149 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.324863    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\") pod \"75eec311-08dc-41bc-8028-f4aed74e21af\" (UID: \"75eec311-08dc-41bc-8028-f4aed74e21af\") "
Oct 30 10:46:24.325397 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.325371    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.325947 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.325689    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.326043 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.325928    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.326761 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.326732    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.326848 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.326805    4488 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.326906 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.326852    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.327476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.327449    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.327476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.327508    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.329497 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.329395    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.329558 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.329528    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:46:24.329612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.329571    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.330625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.329912    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:46:24.330625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.330589    4488 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.330952 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.330913    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:24.331146 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.331098    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.331385 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.331335    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "kube-api-access-qbmf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:46:24.331658 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.331630    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.332543 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.332520    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.332957 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.332931    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.333120 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.333103    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:46:24.345593 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.345568    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config" pod "75eec311-08dc-41bc-8028-f4aed74e21af" (UID: "75eec311-08dc-41bc-8028-f4aed74e21af"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:46:24.431860 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431827    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.431860 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431862    4488 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-metrics-client-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431879    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbmf6\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-kube-api-access-qbmf6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431896    4488 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431911    4488 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-config-out\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431924    4488 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431938    4488 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431952    4488 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431966    4488 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75eec311-08dc-41bc-8028-f4aed74e21af-prometheus-k8s-db\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431980    4488 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-grpc-tls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.431993    4488 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432008 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432006    4488 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432020    4488 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432033    4488 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-web-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432046    4488 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75eec311-08dc-41bc-8028-f4aed74e21af-secret-kube-rbac-proxy\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432059    4488 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432072    4488 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75eec311-08dc-41bc-8028-f4aed74e21af-configmap-metrics-client-ca\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.432290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.432085    4488 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75eec311-08dc-41bc-8028-f4aed74e21af-tls-assets\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:24.584633 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.584610    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:24.588867 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.588848    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:24.617852 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.617830    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:24.618079 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618067    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-web"
Oct 30 10:46:24.618118 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618080    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-web"
Oct 30 10:46:24.618118 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618093    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-thanos"
Oct 30 10:46:24.618118 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618098    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-thanos"
Oct 30 10:46:24.618118 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618113    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="thanos-sidecar"
Oct 30 10:46:24.618118 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618118    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="thanos-sidecar"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618124    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618129    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618137    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="prometheus"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618141    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="prometheus"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618149    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="init-config-reloader"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618154    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="init-config-reloader"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618160    4488 cpu_manager.go:414] "containerMap: removing container" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="config-reloader"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618165    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="config-reloader"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618202    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="thanos-sidecar"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618208    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618216    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="prometheus"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618223    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="config-reloader"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618230    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-web"
Oct 30 10:46:24.618257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.618237    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" containerName="kube-rbac-proxy-thanos"
Oct 30 10:46:24.623086 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.623071    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.639982 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.639962    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 10:46:24.640117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.639979    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 10:46:24.640117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640000    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 10:46:24.640117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.639964    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 10:46:24.640326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640305    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 10:46:24.640461 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640441    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 10:46:24.640856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640696    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 10:46:24.640856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640757    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-hs0dccberl7e\""
Oct 30 10:46:24.640856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640797    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 10:46:24.640856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640831    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 10:46:24.641090 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640857    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 10:46:24.641090 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640905    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 10:46:24.641090 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.640949    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 10:46:24.641090 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.641019    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 10:46:24.654274 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.654242    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vkdsr\""
Oct 30 10:46:24.654795 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.654772    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 10:46:24.655557 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.655540    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 10:46:24.656404 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.656385    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:24.733140 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733118    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrnf\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-kube-api-access-7zrnf\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733243 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733147    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733243 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733165    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733243 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733182    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733243    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733337    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733540 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733442    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733540 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733469    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733540 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733496    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733652 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733592    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733652 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733617    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733753 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733682    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733753 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733713    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733753 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733736    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733858 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733828    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733858 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733850    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733869    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.733948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733891    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.734012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.733974    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.734012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.734004    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835156    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835190    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835216    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835244    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835269    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835300    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrnf\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-kube-api-access-7zrnf\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.835942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835334    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836000 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835936    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836000 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835966    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835999    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836029    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836058    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836081    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836110    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836153    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836182    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836217    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836231    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836248    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.835966    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836304 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836291    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836714 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836326    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.836822 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836797    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.838476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.838450    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.838869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.838768    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.838869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.838786    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.838869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.836217    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.838869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.838833    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.838925    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839069    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839069    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839278 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839134    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839278 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839273    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839437 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839367    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.839608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.839559    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.840951 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.840924    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.840951 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.840938    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.841109 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.841081    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24b9a44c-90ee-44b5-be89-4bdebddc63ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.841488 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.841469    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24b9a44c-90ee-44b5-be89-4bdebddc63ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.859756 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.859736    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrnf\" (UniqueName: \"kubernetes.io/projected/24b9a44c-90ee-44b5-be89-4bdebddc63ba-kube-api-access-7zrnf\") pod \"prometheus-k8s-0\" (UID: \"24b9a44c-90ee-44b5-be89-4bdebddc63ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:24.948373 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:24.948334    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:25.279898 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:25.279871    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 10:46:25.279898 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:46:25.279889    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b9a44c_90ee_44b5_be89_4bdebddc63ba.slice/crio-b2a89d48629fbd02e194c4879167e16257f7080c78b275ceb32ffcd9fdb7280a WatchSource:0}: Error finding container b2a89d48629fbd02e194c4879167e16257f7080c78b275ceb32ffcd9fdb7280a: Status 404 returned error can't find the container with id b2a89d48629fbd02e194c4879167e16257f7080c78b275ceb32ffcd9fdb7280a
Oct 30 10:46:25.802670 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:25.802642    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75eec311-08dc-41bc-8028-f4aed74e21af" path="/var/lib/kubelet/pods/75eec311-08dc-41bc-8028-f4aed74e21af/volumes"
Oct 30 10:46:26.245907 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.245875    4488 generic.go:356] "Generic (PLEG): container finished" podID="24b9a44c-90ee-44b5-be89-4bdebddc63ba" containerID="6b74e52827560d9656c0e3d58e0f1109dfe80d50ba6d05cf83529908ebea806b" exitCode=0
Oct 30 10:46:26.246044 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.245933    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerDied","Data":"6b74e52827560d9656c0e3d58e0f1109dfe80d50ba6d05cf83529908ebea806b"}
Oct 30 10:46:26.246044 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.246032    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"b2a89d48629fbd02e194c4879167e16257f7080c78b275ceb32ffcd9fdb7280a"}
Oct 30 10:46:26.252349 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.252315    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:46:26.252546 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.252519    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" podUID="1067af18-9e29-4775-9bf5-a648e451a59f" containerName="insights-gathering" containerID="cri-o://4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698" gracePeriod=30
Oct 30 10:46:26.506876 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.506852    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:46:26.648583 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.648554    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\") pod \"1067af18-9e29-4775-9bf5-a648e451a59f\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") "
Oct 30 10:46:26.648770 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.648740    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\") pod \"1067af18-9e29-4775-9bf5-a648e451a59f\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") "
Oct 30 10:46:26.648888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.648786    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\" (UniqueName: \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\") pod \"1067af18-9e29-4775-9bf5-a648e451a59f\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") "
Oct 30 10:46:26.648888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.648831    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\") pod \"1067af18-9e29-4775-9bf5-a648e451a59f\" (UID: \"1067af18-9e29-4775-9bf5-a648e451a59f\") "
Oct 30 10:46:26.649102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.648826    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path" pod "1067af18-9e29-4775-9bf5-a648e451a59f" (UID: "1067af18-9e29-4775-9bf5-a648e451a59f"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:46:26.649410 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.649389    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle" pod "1067af18-9e29-4775-9bf5-a648e451a59f" (UID: "1067af18-9e29-4775-9bf5-a648e451a59f"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:26.649967 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.649940    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle" pod "1067af18-9e29-4775-9bf5-a648e451a59f" (UID: "1067af18-9e29-4775-9bf5-a648e451a59f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:46:26.652741 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.652706    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl" pod "1067af18-9e29-4775-9bf5-a648e451a59f" (UID: "1067af18-9e29-4775-9bf5-a648e451a59f"). InnerVolumeSpecName "kube-api-access-8xbkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:46:26.750209 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.750181    4488 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1067af18-9e29-4775-9bf5-a648e451a59f-archives-path\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:26.750306 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.750215    4488 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-trusted-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:26.750306 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.750232    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xbkl\" (UniqueName: \"kubernetes.io/projected/1067af18-9e29-4775-9bf5-a648e451a59f-kube-api-access-8xbkl\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:26.750306 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:26.750247    4488 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1067af18-9e29-4775-9bf5-a648e451a59f-service-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:46:27.250679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.250642    4488 generic.go:356] "Generic (PLEG): container finished" podID="1067af18-9e29-4775-9bf5-a648e451a59f" containerID="4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698" exitCode=2
Oct 30 10:46:27.250849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.250689    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6"
Oct 30 10:46:27.250849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.250723    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" event={"ID":"1067af18-9e29-4775-9bf5-a648e451a59f","Type":"ContainerDied","Data":"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"}
Oct 30 10:46:27.250849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.250783    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8p8p2-b2jk6" event={"ID":"1067af18-9e29-4775-9bf5-a648e451a59f","Type":"ContainerDied","Data":"40d12fc4cb134960bcc7916ac8a303e0eeddbb4db311ee11ac5a4ef46b8cc1d8"}
Oct 30 10:46:27.250849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.250811    4488 scope.go:122] "RemoveContainer" containerID="4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"
Oct 30 10:46:27.254515 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254494    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"61de4ac4e2e0a4655d5389dd70c46c8e4e6f35f2d9589d4329ee7f6f733021a2"}
Oct 30 10:46:27.254634 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254548    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"665b7d57e89ab5d09c5ae067bdc1039fc93d0f0554dd6ed232935e2714c5cb49"}
Oct 30 10:46:27.254634 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254576    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"01a187535eb3bd9da3408f314a2fe9ac9526eca1c3a5067f1031f06ee5e4910d"}
Oct 30 10:46:27.254634 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254601    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"933f58b327cb52bc3a5d949d19ae7d1877f9624f491efa72aef3b872eaa88137"}
Oct 30 10:46:27.254634 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254623    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"5c3dc8337bff89ef2c46fd7c25eb87ba0fb29758fb10b0a37cf63fac640461f1"}
Oct 30 10:46:27.254787 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.254646    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24b9a44c-90ee-44b5-be89-4bdebddc63ba","Type":"ContainerStarted","Data":"5eba6e435e1bd621f06ad7c0c2531f8fe24b7ecf59321563940959f4b94d20b2"}
Oct 30 10:46:27.259362 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.259325    4488 scope.go:122] "RemoveContainer" containerID="4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"
Oct 30 10:46:27.259604 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:27.259584    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698\": container with ID starting with 4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698 not found: ID does not exist" containerID="4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"
Oct 30 10:46:27.259663 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.259614    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698"} err="failed to get container status \"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698\": rpc error: code = NotFound desc = could not find container \"4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698\": container with ID starting with 4f86e2a9b27d5476a4e69f6578b457622b600e56f9184aec98b99ce715048698 not found: ID does not exist"
Oct 30 10:46:27.355869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.355826    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.339336836 podStartE2EDuration="3.355813318s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.476482ms" isStatefulPod=false podCreationTimestamp="2026-10-30 10:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:46:27.34072311 +0000 UTC m=+83.686314963" watchObservedRunningTime="2026-10-30 10:46:27.355813318 +0000 UTC m=+83.701405151"
Oct 30 10:46:27.378146 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.378120    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:46:27.382041 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.382022    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-8p8p2-b2jk6"]
Oct 30 10:46:27.801755 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:27.801726    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1067af18-9e29-4775-9bf5-a648e451a59f" path="/var/lib/kubelet/pods/1067af18-9e29-4775-9bf5-a648e451a59f/volumes"
Oct 30 10:46:29.949237 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:46:29.949204    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:46:31.478066 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:46:31.478029    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:47:01.478161 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:47:01.478114    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:47:24.948998 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:47:24.948908    4488 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:47:24.964197 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:47:24.964168    4488 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:47:25.473193 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:47:25.473169    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 10:47:31.478568 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:47:31.478529    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:48:01.477492 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:48:01.477456    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:48:31.478334 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:48:31.478300    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:49:01.477857 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:49:01.477815    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:49:31.477010 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:49:31.476972    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:50:01.477667 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:50:01.477627    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:50:31.477632 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:50:31.477554    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:51:01.478070 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:51:01.478029    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:51:31.477959 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:51:31.477919    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:52:01.477107 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:52:01.477070    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:52:31.478117 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:52:31.478081    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:53:01.477691 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:53:01.477653    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:53:31.477620 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:53:31.477538    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:53:38.391180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.391147    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:38.391669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.391430    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1067af18-9e29-4775-9bf5-a648e451a59f" containerName="insights-gathering"
Oct 30 10:53:38.391669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.391442    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1067af18-9e29-4775-9bf5-a648e451a59f" containerName="insights-gathering"
Oct 30 10:53:38.391669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.391496    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1067af18-9e29-4775-9bf5-a648e451a59f" containerName="insights-gathering"
Oct 30 10:53:38.394251 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.394228    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.421407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.421386    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"openshift-service-ca.crt\""
Oct 30 10:53:38.435283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.435265    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"kube-root-ca.crt\""
Oct 30 10:53:38.436233 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.436211    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:38.462919 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.462892    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.463015 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.462926    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgh9k\" (UniqueName: \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.463015 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.462963    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.512549 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.512516    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-webhook-service-cert\""
Oct 30 10:53:38.512549 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.512515    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-controller-manager-dockercfg-tdlw7\""
Oct 30 10:53:38.564059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.564033    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.564180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.564086    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.564248 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.564204    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgh9k\" (UniqueName: \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.566478 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.566451    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.566565 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.566508    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.600153 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.600124    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgh9k\" (UniqueName: \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\") pod \"opentelemetry-operator-webhook-86cd56cc8c-82rbk\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:38.705373 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:38.705355    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:39.039142 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:39.038975    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:39.042063 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:53:39.042032    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2608ce_7c27_4237_88a0_6bbecd7be9f0.slice/crio-771721e55d74959fc99c6cd0262a21fd5554473ada6dc039a89b9b5a819a3133 WatchSource:0}: Error finding container 771721e55d74959fc99c6cd0262a21fd5554473ada6dc039a89b9b5a819a3133: Status 404 returned error can't find the container with id 771721e55d74959fc99c6cd0262a21fd5554473ada6dc039a89b9b5a819a3133
Oct 30 10:53:39.044296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:39.044280    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 10:53:39.692831 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:39.692792    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" event={"ID":"ce2608ce-7c27-4237-88a0-6bbecd7be9f0","Type":"ContainerStarted","Data":"771721e55d74959fc99c6cd0262a21fd5554473ada6dc039a89b9b5a819a3133"}
Oct 30 10:53:40.697641 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:40.697564    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" event={"ID":"ce2608ce-7c27-4237-88a0-6bbecd7be9f0","Type":"ContainerStarted","Data":"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"}
Oct 30 10:53:40.698017 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:40.697715    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:40.785041 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:40.784992    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" podStartSLOduration=1.386536219 podStartE2EDuration="2.784978196s" totalImagesPullingTime="1.398441977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:53:40.770187879 +0000 UTC m=+517.115779734" watchObservedRunningTime="2026-10-30 10:53:40.784978196 +0000 UTC m=+517.130570049"
Oct 30 10:53:41.649688 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:41.649656    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:42.704190 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:42.704151    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" podUID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" containerName="webhook" containerID="cri-o://90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93" gracePeriod=30
Oct 30 10:53:42.945682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:42.945658    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:43.002057 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.001995    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\") pod \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") "
Oct 30 10:53:43.002167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.002102    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\") pod \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") "
Oct 30 10:53:43.002167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.002160    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\" (UniqueName: \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\") pod \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\" (UID: \"ce2608ce-7c27-4237-88a0-6bbecd7be9f0\") "
Oct 30 10:53:43.004327 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.004293    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert" pod "ce2608ce-7c27-4237-88a0-6bbecd7be9f0" (UID: "ce2608ce-7c27-4237-88a0-6bbecd7be9f0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:53:43.004461 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.004408    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k" pod "ce2608ce-7c27-4237-88a0-6bbecd7be9f0" (UID: "ce2608ce-7c27-4237-88a0-6bbecd7be9f0"). InnerVolumeSpecName "kube-api-access-tgh9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:53:43.004741 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.004718    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert" pod "ce2608ce-7c27-4237-88a0-6bbecd7be9f0" (UID: "ce2608ce-7c27-4237-88a0-6bbecd7be9f0"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:53:43.103094 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.103070    4488 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-apiservice-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:53:43.103094 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.103090    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgh9k\" (UniqueName: \"kubernetes.io/projected/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-kube-api-access-tgh9k\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:53:43.103239 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.103099    4488 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce2608ce-7c27-4237-88a0-6bbecd7be9f0-webhook-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:53:43.708538 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.708507    4488 generic.go:356] "Generic (PLEG): container finished" podID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" containerID="90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93" exitCode=0
Oct 30 10:53:43.709056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.708546    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" event={"ID":"ce2608ce-7c27-4237-88a0-6bbecd7be9f0","Type":"ContainerDied","Data":"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"}
Oct 30 10:53:43.709056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.708554    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"
Oct 30 10:53:43.709056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.708581    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk" event={"ID":"ce2608ce-7c27-4237-88a0-6bbecd7be9f0","Type":"ContainerDied","Data":"771721e55d74959fc99c6cd0262a21fd5554473ada6dc039a89b9b5a819a3133"}
Oct 30 10:53:43.709056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.708601    4488 scope.go:122] "RemoveContainer" containerID="90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"
Oct 30 10:53:43.716643 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.716521    4488 scope.go:122] "RemoveContainer" containerID="90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"
Oct 30 10:53:43.716814 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:53:43.716789    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93\": container with ID starting with 90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93 not found: ID does not exist" containerID="90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"
Oct 30 10:53:43.716860 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.716826    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93"} err="failed to get container status \"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93\": rpc error: code = NotFound desc = could not find container \"90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93\": container with ID starting with 90a976dea2808e8b776f26f8c689f1bde234484792421f1ab37dd24cbe844f93 not found: ID does not exist"
Oct 30 10:53:43.779021 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.778992    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:43.792749 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.792730    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-86cd56cc8c-82rbk"]
Oct 30 10:53:43.802541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:43.802518    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" path="/var/lib/kubelet/pods/ce2608ce-7c27-4237-88a0-6bbecd7be9f0/volumes"
Oct 30 10:53:55.825725 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.825690    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"]
Oct 30 10:53:55.826167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.826008    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" containerName="webhook"
Oct 30 10:53:55.826167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.826023    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" containerName="webhook"
Oct 30 10:53:55.826167 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.826084    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce2608ce-7c27-4237-88a0-6bbecd7be9f0" containerName="webhook"
Oct 30 10:53:55.828968 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.828952    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.841748 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.841722    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"]
Oct 30 10:53:55.855521 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855499    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-metrics\""
Oct 30 10:53:55.855682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855547    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-service-cert\""
Oct 30 10:53:55.855682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855671    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-dockercfg-g9lx5\""
Oct 30 10:53:55.855682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855571    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-manager-config\""
Oct 30 10:53:55.855850 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855596    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"openshift-service-ca.crt\""
Oct 30 10:53:55.855850 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.855566    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"kube-root-ca.crt\""
Oct 30 10:53:55.891712 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.891685    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.891803 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.891729    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-apiservice-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.891803 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.891761    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-webhook-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.891877 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.891803    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4qm\" (UniqueName: \"kubernetes.io/projected/b6c48581-92bb-49f8-9394-2ae86298161b-kube-api-access-tk4qm\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.891877 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.891857    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6c48581-92bb-49f8-9394-2ae86298161b-manager-config\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.992996 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.992970    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.993102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.993011    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-apiservice-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.993102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.993033    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-webhook-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.993102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.993049    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4qm\" (UniqueName: \"kubernetes.io/projected/b6c48581-92bb-49f8-9394-2ae86298161b-kube-api-access-tk4qm\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.993102 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.993080    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6c48581-92bb-49f8-9394-2ae86298161b-manager-config\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.993799 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.993780    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6c48581-92bb-49f8-9394-2ae86298161b-manager-config\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.995455 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.995430    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-webhook-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.995540 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.995480    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-apiservice-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:55.995625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:55.995604    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6c48581-92bb-49f8-9394-2ae86298161b-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:56.021034 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:56.021009    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4qm\" (UniqueName: \"kubernetes.io/projected/b6c48581-92bb-49f8-9394-2ae86298161b-kube-api-access-tk4qm\") pod \"loki-operator-controller-manager-6d9d597c9b-l65gv\" (UID: \"b6c48581-92bb-49f8-9394-2ae86298161b\") " pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:56.156271 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:56.156222    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:53:56.480788 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:56.480764    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"]
Oct 30 10:53:56.483331 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:53:56.483301    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6c48581_92bb_49f8_9394_2ae86298161b.slice/crio-29918172f70e0962bfb8f9adc332cf42b8c1819e5fe450a6d54fd581b86bc13a WatchSource:0}: Error finding container 29918172f70e0962bfb8f9adc332cf42b8c1819e5fe450a6d54fd581b86bc13a: Status 404 returned error can't find the container with id 29918172f70e0962bfb8f9adc332cf42b8c1819e5fe450a6d54fd581b86bc13a
Oct 30 10:53:56.753557 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:53:56.753476    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv" event={"ID":"b6c48581-92bb-49f8-9394-2ae86298161b","Type":"ContainerStarted","Data":"29918172f70e0962bfb8f9adc332cf42b8c1819e5fe450a6d54fd581b86bc13a"}
Oct 30 10:54:00.771822 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:00.771784    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv" event={"ID":"b6c48581-92bb-49f8-9394-2ae86298161b","Type":"ContainerStarted","Data":"78c9b43959140b2607bacda7f1483efdb2dad5df601ce7b8e6658e4c12ff0e18"}
Oct 30 10:54:00.772251 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:00.771855    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:54:00.858482 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:00.858431    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv" podStartSLOduration=2.006100728 podStartE2EDuration="5.858410416s" totalImagesPullingTime="3.852309688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:00.843268781 +0000 UTC m=+537.188860634" watchObservedRunningTime="2026-10-30 10:54:00.858410416 +0000 UTC m=+537.204002271"
Oct 30 10:54:01.476828 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:01.476796    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:54:11.778421 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:11.778389    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators-redhat/loki-operator-controller-manager-6d9d597c9b-l65gv"
Oct 30 10:54:22.020511 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.020474    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:22.023979 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.023956    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.056826 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.056804    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 10:54:22.056972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.056804    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 10:54:22.056972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.056787    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 10:54:22.056972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.056832    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 10:54:22.058089 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.058071    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:22.175277 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.175255    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9gx\" (UniqueName: \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.175452 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.175285    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.175452 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.175326    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.275894 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.275817    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.275894 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.275864    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9gx\" (UniqueName: \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.275894 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.275884    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.276207 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.276184    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.276473 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.276458    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:22.300548 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:22.300526    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9gx\" (UniqueName: \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.198175 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.198143    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.231613 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.231586    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.299027 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.299001    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.299139 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.299124    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.315370 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.315332    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.498557 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.498530    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.524312 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.524281    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.635026 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.635006    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:25.930289 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:25.930247    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:25.933694 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:54:25.933670    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16e6cf94_e497_4985_9a6a_3e42c9798d90.slice/crio-2922cf02aa08045932167906b7a3b96157c7378198cb3978f9d09ff958c6fc93 WatchSource:0}: Error finding container 2922cf02aa08045932167906b7a3b96157c7378198cb3978f9d09ff958c6fc93: Status 404 returned error can't find the container with id 2922cf02aa08045932167906b7a3b96157c7378198cb3978f9d09ff958c6fc93
Oct 30 10:54:26.865820 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:26.865782    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"16e6cf94-e497-4985-9a6a-3e42c9798d90","Type":"ContainerStarted","Data":"2922cf02aa08045932167906b7a3b96157c7378198cb3978f9d09ff958c6fc93"}
Oct 30 10:54:29.881935 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:29.881893    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"16e6cf94-e497-4985-9a6a-3e42c9798d90","Type":"ContainerStarted","Data":"2d7b5f7d58bca252f4693cf0a73132796a186bd127be465d3601ddf0332b004e"}
Oct 30 10:54:29.882445 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:29.882035    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:29.927550 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:29.927490    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=8.685869445 podStartE2EDuration="11.927471398s" totalImagesPullingTime="3.241601953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:29.926083659 +0000 UTC m=+566.271675515" watchObservedRunningTime="2026-10-30 10:54:29.927471398 +0000 UTC m=+566.273063252"
Oct 30 10:54:31.478210 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:31.478107    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:54:37.764214 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:37.764182    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:37.764689 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:37.764435    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="16e6cf94-e497-4985-9a6a-3e42c9798d90" containerName="perses" containerID="cri-o://2d7b5f7d58bca252f4693cf0a73132796a186bd127be465d3601ddf0332b004e" gracePeriod=30
Oct 30 10:54:37.914840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:37.914802    4488 generic.go:356] "Generic (PLEG): container finished" podID="16e6cf94-e497-4985-9a6a-3e42c9798d90" containerID="2d7b5f7d58bca252f4693cf0a73132796a186bd127be465d3601ddf0332b004e" exitCode=0
Oct 30 10:54:37.914992 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:37.914864    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"16e6cf94-e497-4985-9a6a-3e42c9798d90","Type":"ContainerDied","Data":"2d7b5f7d58bca252f4693cf0a73132796a186bd127be465d3601ddf0332b004e"}
Oct 30 10:54:38.005212 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.005191    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:38.011902 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.011884    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\" (UniqueName: \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\") pod \"16e6cf94-e497-4985-9a6a-3e42c9798d90\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") "
Oct 30 10:54:38.012030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.012012    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"16e6cf94-e497-4985-9a6a-3e42c9798d90\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") "
Oct 30 10:54:38.012084 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.012067    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\" (UniqueName: \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\") pod \"16e6cf94-e497-4985-9a6a-3e42c9798d90\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") "
Oct 30 10:54:38.012137 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.012123    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\" (UniqueName: \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\") pod \"16e6cf94-e497-4985-9a6a-3e42c9798d90\" (UID: \"16e6cf94-e497-4985-9a6a-3e42c9798d90\") "
Oct 30 10:54:38.012527 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.012499    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config" pod "16e6cf94-e497-4985-9a6a-3e42c9798d90" (UID: "16e6cf94-e497-4985-9a6a-3e42c9798d90"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:54:38.014048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.014026    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx" pod "16e6cf94-e497-4985-9a6a-3e42c9798d90" (UID: "16e6cf94-e497-4985-9a6a-3e42c9798d90"). InnerVolumeSpecName "kube-api-access-jm9gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:54:38.015745 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.015694    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "16e6cf94-e497-4985-9a6a-3e42c9798d90" (UID: "16e6cf94-e497-4985-9a6a-3e42c9798d90"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 10:54:38.112763 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.112728    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm9gx\" (UniqueName: \"kubernetes.io/projected/16e6cf94-e497-4985-9a6a-3e42c9798d90-kube-api-access-jm9gx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:54:38.112923 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.112777    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 10:54:38.112923 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.112788    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6cf94-e497-4985-9a6a-3e42c9798d90-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:54:38.124180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.124157    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 10:54:38.141393 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.141364    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins" pod "16e6cf94-e497-4985-9a6a-3e42c9798d90" (UID: "16e6cf94-e497-4985-9a6a-3e42c9798d90"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 10:54:38.213889 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.213857    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 10:54:38.214010 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.213893    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/16e6cf94-e497-4985-9a6a-3e42c9798d90-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:54:38.919523 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.919492    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"16e6cf94-e497-4985-9a6a-3e42c9798d90","Type":"ContainerDied","Data":"2922cf02aa08045932167906b7a3b96157c7378198cb3978f9d09ff958c6fc93"}
Oct 30 10:54:38.919523 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.919515    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:38.920017 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.919541    4488 scope.go:122] "RemoveContainer" containerID="2d7b5f7d58bca252f4693cf0a73132796a186bd127be465d3601ddf0332b004e"
Oct 30 10:54:38.974350 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.974322    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:38.988373 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:38.988334    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:39.801484 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:39.801451    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16e6cf94-e497-4985-9a6a-3e42c9798d90" path="/var/lib/kubelet/pods/16e6cf94-e497-4985-9a6a-3e42c9798d90/volumes"
Oct 30 10:54:43.852059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.852029    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:43.852551 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.852311    4488 cpu_manager.go:414] "containerMap: removing container" podUID="16e6cf94-e497-4985-9a6a-3e42c9798d90" containerName="perses"
Oct 30 10:54:43.852551 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.852322    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16e6cf94-e497-4985-9a6a-3e42c9798d90" containerName="perses"
Oct 30 10:54:43.852551 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.852390    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="16e6cf94-e497-4985-9a6a-3e42c9798d90" containerName="perses"
Oct 30 10:54:43.872639 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.872618    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:43.874984 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.874956    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:43.899404 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.899383    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 10:54:43.902779 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.902761    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 10:54:43.902888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.902789    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 10:54:43.954483 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:43.954452    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sltg\" (UniqueName: \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476\" (UID: \"b1fda40c-5a03-457a-a6c6-6df09f7d9db0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:44.054979 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.054950    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sltg\" (UniqueName: \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476\" (UID: \"b1fda40c-5a03-457a-a6c6-6df09f7d9db0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:44.080056 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.080030    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sltg\" (UniqueName: \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476\" (UID: \"b1fda40c-5a03-457a-a6c6-6df09f7d9db0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:44.184326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.184301    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:44.477888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.477823    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:44.480936 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:54:44.480913    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1fda40c_5a03_457a_a6c6_6df09f7d9db0.slice/crio-e7b4c4c353923418eafec2d3499a35d1787ae90059b1127282729918164fffdc WatchSource:0}: Error finding container e7b4c4c353923418eafec2d3499a35d1787ae90059b1127282729918164fffdc: Status 404 returned error can't find the container with id e7b4c4c353923418eafec2d3499a35d1787ae90059b1127282729918164fffdc
Oct 30 10:54:44.868307 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.868230    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:44.873119 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.873096    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:44.891411 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.891388    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:44.929884 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.929850    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 10:54:44.943888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.943861    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:54:44.950784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.950756    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" event={"ID":"b1fda40c-5a03-457a-a6c6-6df09f7d9db0","Type":"ContainerStarted","Data":"e7b4c4c353923418eafec2d3499a35d1787ae90059b1127282729918164fffdc"}
Oct 30 10:54:44.950911 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.950856    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:44.967059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.967039    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:54:44.967842 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.967821    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 10:54:44.967972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:44.967926    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-gt4fs\""
Oct 30 10:54:45.029688 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.029665    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 10:54:45.061986 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.061961    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.062096 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.061995    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tk5q\" (UniqueName: \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.062096 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.062019    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.062174 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.062113    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.062174 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.062165    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92m9g\" (UniqueName: \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.062303 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.062191    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.163078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.162996    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.163078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163047    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.163293 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163109    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92m9g\" (UniqueName: \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.163293 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163148    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.163293 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163201    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.163293 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:45.163218    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 10:54:45.163293 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163238    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tk5q\" (UniqueName: \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.163551 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:45.163304    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert podName:4531c8c4-9d50-401c-a478-554a246a1648 nodeName:}" failed. No retries permitted until 2026-10-30 10:54:45.663282622 +0000 UTC m=+582.008874462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-768bd69746-z4llq" (UID: "4531c8c4-9d50-401c-a478-554a246a1648") : secret "data-science-collector-ta-server-cert" not found
Oct 30 10:54:45.163734 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163715    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.164001 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.163983    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.164100 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.164082    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.191783 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.191739    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92m9g\" (UniqueName: \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.192015 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.191991    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tk5q\" (UniqueName: \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.667823 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.667780    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:45.668008 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:45.667921    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 10:54:45.668078 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:45.668015    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert podName:4531c8c4-9d50-401c-a478-554a246a1648 nodeName:}" failed. No retries permitted until 2026-10-30 10:54:46.667994628 +0000 UTC m=+583.013586473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-768bd69746-z4llq" (UID: "4531c8c4-9d50-401c-a478-554a246a1648") : secret "data-science-collector-ta-server-cert" not found
Oct 30 10:54:45.769104 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.769069    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.815464 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.815421    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.869845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.869811    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.870290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.869966    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.885886 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.885846    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:45.994723 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:45.994697    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:46.022355 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.022310    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:46.085213 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.085184    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:46.387830 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.387727    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 10:54:46.390721 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:54:46.390697    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3d857cb_273f_425d_8bc2_806925823430.slice/crio-9dc009b9b8d0cea369e0b4f63d68695bd4b336afb98b7cc0afe3a8de96a4f07f WatchSource:0}: Error finding container 9dc009b9b8d0cea369e0b4f63d68695bd4b336afb98b7cc0afe3a8de96a4f07f: Status 404 returned error can't find the container with id 9dc009b9b8d0cea369e0b4f63d68695bd4b336afb98b7cc0afe3a8de96a4f07f
Oct 30 10:54:46.676124 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.676093    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:46.679062 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.679037    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-768bd69746-z4llq\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:46.762275 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.762234    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:46.955525 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.955450    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f3d857cb-273f-425d-8bc2-806925823430","Type":"ContainerStarted","Data":"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"}
Oct 30 10:54:46.955525 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.955496    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f3d857cb-273f-425d-8bc2-806925823430","Type":"ContainerStarted","Data":"9dc009b9b8d0cea369e0b4f63d68695bd4b336afb98b7cc0afe3a8de96a4f07f"}
Oct 30 10:54:46.955968 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:46.955533    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:54:47.000259 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.000205    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=3.000189887 podStartE2EDuration="3.000189887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 10:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:46.998272749 +0000 UTC m=+583.343864645" watchObservedRunningTime="2026-10-30 10:54:47.000189887 +0000 UTC m=+583.345781744"
Oct 30 10:54:47.075806 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.075731    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:54:47.078461 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:54:47.078431    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4531c8c4_9d50_401c_a478_554a246a1648.slice/crio-af79f45bd07b995ff4549157c75e9306bb06444960b5e3ee77ffd785c94cf2a7 WatchSource:0}: Error finding container af79f45bd07b995ff4549157c75e9306bb06444960b5e3ee77ffd785c94cf2a7: Status 404 returned error can't find the container with id af79f45bd07b995ff4549157c75e9306bb06444960b5e3ee77ffd785c94cf2a7
Oct 30 10:54:47.329816 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.329787    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 10:54:47.335824 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.335800    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 10:54:47.350489 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.350466    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 10:54:47.483327 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.483288    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22s4\" (UniqueName: \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4n847\" (UID: \"c1d061e4-c52e-4840-912e-5723e05c689e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 10:54:47.584745 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.584660    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22s4\" (UniqueName: \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4n847\" (UID: \"c1d061e4-c52e-4840-912e-5723e05c689e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 10:54:47.609703 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.609672    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22s4\" (UniqueName: \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4n847\" (UID: \"c1d061e4-c52e-4840-912e-5723e05c689e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 10:54:47.649602 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.649574    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 10:54:47.962335 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.962296    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" event={"ID":"b1fda40c-5a03-457a-a6c6-6df09f7d9db0","Type":"ContainerStarted","Data":"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"}
Oct 30 10:54:47.964831 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.964807    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 10:54:47.965589 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:47.965561    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" event={"ID":"4531c8c4-9d50-401c-a478-554a246a1648","Type":"ContainerStarted","Data":"af79f45bd07b995ff4549157c75e9306bb06444960b5e3ee77ffd785c94cf2a7"}
Oct 30 10:54:47.969941 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:54:47.969916    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1d061e4_c52e_4840_912e_5723e05c689e.slice/crio-f1d747c44d91c27b9514f167bb4ad409803f71064f4247fcc7ff4b9a23fe0ff2 WatchSource:0}: Error finding container f1d747c44d91c27b9514f167bb4ad409803f71064f4247fcc7ff4b9a23fe0ff2: Status 404 returned error can't find the container with id f1d747c44d91c27b9514f167bb4ad409803f71064f4247fcc7ff4b9a23fe0ff2
Oct 30 10:54:48.007722 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:48.007663    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" podStartSLOduration=2.224705324 podStartE2EDuration="5.007642919s" totalImagesPullingTime="2.782937595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:48.006703298 +0000 UTC m=+584.352295220" watchObservedRunningTime="2026-10-30 10:54:48.007642919 +0000 UTC m=+584.353234778"
Oct 30 10:54:48.971591 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:48.971558    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" event={"ID":"c1d061e4-c52e-4840-912e-5723e05c689e","Type":"ContainerStarted","Data":"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"}
Oct 30 10:54:48.972059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:48.971602    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" event={"ID":"c1d061e4-c52e-4840-912e-5723e05c689e","Type":"ContainerStarted","Data":"f1d747c44d91c27b9514f167bb4ad409803f71064f4247fcc7ff4b9a23fe0ff2"}
Oct 30 10:54:49.019270 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.019202    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" podStartSLOduration=2.019185209 podStartE2EDuration="2.019185209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:49.018139381 +0000 UTC m=+585.363731236" watchObservedRunningTime="2026-10-30 10:54:49.019185209 +0000 UTC m=+585.364777065"
Oct 30 10:54:49.046105 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.046077    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:49.133688 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.133654    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:54:49.133802 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.133715    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:54:49.976971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.976932    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" event={"ID":"4531c8c4-9d50-401c-a478-554a246a1648","Type":"ContainerStarted","Data":"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"}
Oct 30 10:54:49.977462 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.977092    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" podUID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" containerName="thanos-querier" containerID="cri-o://367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87" gracePeriod=30
Oct 30 10:54:49.977462 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.977110    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:49.978769 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:49.978748    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:54:50.020834 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.020760    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" podStartSLOduration=3.96882879 podStartE2EDuration="6.020744762s" totalImagesPullingTime="2.051915972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:54:50.020389703 +0000 UTC m=+586.365981557" watchObservedRunningTime="2026-10-30 10:54:50.020744762 +0000 UTC m=+586.366336617"
Oct 30 10:54:50.214232 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.214209    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:50.305393 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.305309    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\" (UniqueName: \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\") pod \"b1fda40c-5a03-457a-a6c6-6df09f7d9db0\" (UID: \"b1fda40c-5a03-457a-a6c6-6df09f7d9db0\") "
Oct 30 10:54:50.307228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.307201    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg" pod "b1fda40c-5a03-457a-a6c6-6df09f7d9db0" (UID: "b1fda40c-5a03-457a-a6c6-6df09f7d9db0"). InnerVolumeSpecName "kube-api-access-2sltg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:54:50.406725 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.406701    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sltg\" (UniqueName: \"kubernetes.io/projected/b1fda40c-5a03-457a-a6c6-6df09f7d9db0-kube-api-access-2sltg\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:54:50.983416 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.983380    4488 generic.go:356] "Generic (PLEG): container finished" podID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" containerID="367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87" exitCode=0
Oct 30 10:54:50.983864 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.983427    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"
Oct 30 10:54:50.983864 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.983466    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" event={"ID":"b1fda40c-5a03-457a-a6c6-6df09f7d9db0","Type":"ContainerDied","Data":"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"}
Oct 30 10:54:50.983864 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.983508    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476" event={"ID":"b1fda40c-5a03-457a-a6c6-6df09f7d9db0","Type":"ContainerDied","Data":"e7b4c4c353923418eafec2d3499a35d1787ae90059b1127282729918164fffdc"}
Oct 30 10:54:50.983864 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.983525    4488 scope.go:122] "RemoveContainer" containerID="367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"
Oct 30 10:54:50.991552 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.991529    4488 scope.go:122] "RemoveContainer" containerID="367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"
Oct 30 10:54:50.991813 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:54:50.991796    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87\": container with ID starting with 367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87 not found: ID does not exist" containerID="367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"
Oct 30 10:54:50.991856 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:50.991822    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87"} err="failed to get container status \"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87\": rpc error: code = NotFound desc = could not find container \"367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87\": container with ID starting with 367c852624f5b12d87da9832a10ab02e49c1692312ced3186bc63a23f35c1f87 not found: ID does not exist"
Oct 30 10:54:51.038051 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:51.038028    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:51.051748 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:51.051724    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ww476"]
Oct 30 10:54:51.802679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:51.802642    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" path="/var/lib/kubelet/pods/b1fda40c-5a03-457a-a6c6-6df09f7d9db0/volumes"
Oct 30 10:54:57.968050 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:54:57.968025    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 10:55:01.478390 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:55:01.478330    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:55:20.323840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.323808    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:55:20.324219 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.324097    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" containerName="thanos-querier"
Oct 30 10:55:20.324219 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.324107    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" containerName="thanos-querier"
Oct 30 10:55:20.324219 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.324171    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1fda40c-5a03-457a-a6c6-6df09f7d9db0" containerName="thanos-querier"
Oct 30 10:55:20.326961 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.326946    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.361036 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.361015    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:55:20.410526 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.410496    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.410526 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.410526    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4vf\" (UniqueName: \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.410676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.410552    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.511595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.511565    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.511746 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.511598    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4vf\" (UniqueName: \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.511746 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.511626    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.512179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.512153    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.514088 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.514062    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.536097 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.536074    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4vf\" (UniqueName: \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\") pod \"data-science-collector-targetallocator-dc8465767-g4tfs\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.638320 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.638273    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:20.939028 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.938918    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:55:20.941634 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:55:20.941605    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f0f0aeb_1b71_456f_9802_26efaac6be99.slice/crio-55cd93c5ffe572bd34583467d24ba30d600b29d9ae2002566c4e16806a827e97 WatchSource:0}: Error finding container 55cd93c5ffe572bd34583467d24ba30d600b29d9ae2002566c4e16806a827e97: Status 404 returned error can't find the container with id 55cd93c5ffe572bd34583467d24ba30d600b29d9ae2002566c4e16806a827e97
Oct 30 10:55:20.943676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.943640    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:55:20.943735 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:20.943709    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:55:21.098257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:21.098221    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" event={"ID":"6f0f0aeb-1b71-456f-9802-26efaac6be99","Type":"ContainerStarted","Data":"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"}
Oct 30 10:55:21.098500 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:21.098273    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" event={"ID":"6f0f0aeb-1b71-456f-9802-26efaac6be99","Type":"ContainerStarted","Data":"55cd93c5ffe572bd34583467d24ba30d600b29d9ae2002566c4e16806a827e97"}
Oct 30 10:55:21.098500 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:21.098295    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:21.099279 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:21.099251    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.26:8080/readyz\": dial tcp 10.133.0.26:8080: connect: connection refused"
Oct 30 10:55:21.142149 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:21.142101    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" podStartSLOduration=1.142087493 podStartE2EDuration="1.142087493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:55:21.141392539 +0000 UTC m=+617.486984395" watchObservedRunningTime="2026-10-30 10:55:21.142087493 +0000 UTC m=+617.487679347"
Oct 30 10:55:22.103451 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.103421    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:55:22.177598 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.177565    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:55:22.177762 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.177738    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" podUID="4531c8c4-9d50-401c-a478-554a246a1648" containerName="ta-container" containerID="cri-o://4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc" gracePeriod=30
Oct 30 10:55:22.412679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.412655    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:55:22.425706 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.425687    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\") pod \"4531c8c4-9d50-401c-a478-554a246a1648\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") "
Oct 30 10:55:22.425802 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.425745    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\" (UniqueName: \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\") pod \"4531c8c4-9d50-401c-a478-554a246a1648\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") "
Oct 30 10:55:22.425841 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.425816    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") pod \"4531c8c4-9d50-401c-a478-554a246a1648\" (UID: \"4531c8c4-9d50-401c-a478-554a246a1648\") "
Oct 30 10:55:22.426060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.426038    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal" pod "4531c8c4-9d50-401c-a478-554a246a1648" (UID: "4531c8c4-9d50-401c-a478-554a246a1648"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:55:22.427779 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.427757    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert" pod "4531c8c4-9d50-401c-a478-554a246a1648" (UID: "4531c8c4-9d50-401c-a478-554a246a1648"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:55:22.427838 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.427801    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q" pod "4531c8c4-9d50-401c-a478-554a246a1648" (UID: "4531c8c4-9d50-401c-a478-554a246a1648"). InnerVolumeSpecName "kube-api-access-2tk5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:55:22.526684 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.526659    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4531c8c4-9d50-401c-a478-554a246a1648-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:55:22.526684 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.526680    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tk5q\" (UniqueName: \"kubernetes.io/projected/4531c8c4-9d50-401c-a478-554a246a1648-kube-api-access-2tk5q\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:55:22.526877 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:22.526690    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4531c8c4-9d50-401c-a478-554a246a1648-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:55:23.107476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.107446    4488 generic.go:356] "Generic (PLEG): container finished" podID="4531c8c4-9d50-401c-a478-554a246a1648" containerID="4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc" exitCode=0
Oct 30 10:55:23.107859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.107485    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"
Oct 30 10:55:23.107859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.107520    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" event={"ID":"4531c8c4-9d50-401c-a478-554a246a1648","Type":"ContainerDied","Data":"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"}
Oct 30 10:55:23.107859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.107555    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq" event={"ID":"4531c8c4-9d50-401c-a478-554a246a1648","Type":"ContainerDied","Data":"af79f45bd07b995ff4549157c75e9306bb06444960b5e3ee77ffd785c94cf2a7"}
Oct 30 10:55:23.107859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.107573    4488 scope.go:122] "RemoveContainer" containerID="4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"
Oct 30 10:55:23.116169 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.116152    4488 scope.go:122] "RemoveContainer" containerID="4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"
Oct 30 10:55:23.116468 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:55:23.116447    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc\": container with ID starting with 4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc not found: ID does not exist" containerID="4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"
Oct 30 10:55:23.116528 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.116475    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc"} err="failed to get container status \"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc\": rpc error: code = NotFound desc = could not find container \"4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc\": container with ID starting with 4d41c6e688067f27645e00bb424c0d11980fb1386a0806e17ec165a1c0acd6cc not found: ID does not exist"
Oct 30 10:55:23.167537 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.167506    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:55:23.181315 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.181292    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-768bd69746-z4llq"]
Oct 30 10:55:23.802687 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:55:23.802659    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4531c8c4-9d50-401c-a478-554a246a1648" path="/var/lib/kubelet/pods/4531c8c4-9d50-401c-a478-554a246a1648/volumes"
Oct 30 10:55:31.477417 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:55:31.477380    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:56:01.477970 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:56:01.477933    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:56:31.478255 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:56:31.478172    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:56:33.410352 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.410311    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"]
Oct 30 10:56:33.410707 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.410610    4488 cpu_manager.go:414] "containerMap: removing container" podUID="4531c8c4-9d50-401c-a478-554a246a1648" containerName="ta-container"
Oct 30 10:56:33.410707 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.410621    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4531c8c4-9d50-401c-a478-554a246a1648" containerName="ta-container"
Oct 30 10:56:33.410707 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.410675    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="4531c8c4-9d50-401c-a478-554a246a1648" containerName="ta-container"
Oct 30 10:56:33.413658 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.413639    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"
Oct 30 10:56:33.423726 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.423708    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"
Oct 30 10:56:33.429606 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.429584    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"]
Oct 30 10:56:33.720177 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:33.720154    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"]
Oct 30 10:56:33.722752 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:56:33.722722    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92889e1e_3135_413a_a77b_bd19e5230784.slice/crio-62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a WatchSource:0}: Error finding container 62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a: Status 404 returned error can't find the container with id 62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a
Oct 30 10:56:34.375561 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:34.375522    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170" event={"ID":"92889e1e-3135-413a-a77b-bd19e5230784","Type":"ContainerStarted","Data":"62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a"}
Oct 30 10:56:35.380328 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:35.380293    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170" event={"ID":"92889e1e-3135-413a-a77b-bd19e5230784","Type":"ContainerStarted","Data":"0f2e9e13d67592b09603c0741cfabb6ca3b73bff11ff075c31ee96244db6e0b7"}
Oct 30 10:56:35.422141 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:35.422095    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170" podStartSLOduration=1.6726260069999999 podStartE2EDuration="2.422083588s" totalImagesPullingTime="749.457581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:56:35.420858923 +0000 UTC m=+691.766450776" watchObservedRunningTime="2026-10-30 10:56:35.422083588 +0000 UTC m=+691.767675442"
Oct 30 10:56:40.400732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:40.400701    4488 generic.go:356] "Generic (PLEG): container finished" podID="92889e1e-3135-413a-a77b-bd19e5230784" containerID="0f2e9e13d67592b09603c0741cfabb6ca3b73bff11ff075c31ee96244db6e0b7" exitCode=0
Oct 30 10:56:40.401191 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:40.400773    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170" event={"ID":"92889e1e-3135-413a-a77b-bd19e5230784","Type":"ContainerDied","Data":"0f2e9e13d67592b09603c0741cfabb6ca3b73bff11ff075c31ee96244db6e0b7"}
Oct 30 10:56:41.536655 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:41.536632    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"
Oct 30 10:56:42.410179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:42.410153    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"
Oct 30 10:56:42.410335 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:42.410156    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e349695438e170" event={"ID":"92889e1e-3135-413a-a77b-bd19e5230784","Type":"ContainerDied","Data":"62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a"}
Oct 30 10:56:42.410335 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:42.410266    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62587973bffbd5a050b7a130a061d80482f29c142a85ce269d324f1613c8f77a"
Oct 30 10:56:43.510691 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:43.510661    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"]
Oct 30 10:56:43.514576 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:43.514550    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e349695438e170"]
Oct 30 10:56:43.801978 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:43.801910    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92889e1e-3135-413a-a77b-bd19e5230784" path="/var/lib/kubelet/pods/92889e1e-3135-413a-a77b-bd19e5230784/volumes"
Oct 30 10:56:48.414497 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.414462    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:48.414960 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.414933    4488 cpu_manager.go:414] "containerMap: removing container" podUID="92889e1e-3135-413a-a77b-bd19e5230784" containerName="curl"
Oct 30 10:56:48.414960 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.414952    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92889e1e-3135-413a-a77b-bd19e5230784" containerName="curl"
Oct 30 10:56:48.415074 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.415065    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="92889e1e-3135-413a-a77b-bd19e5230784" containerName="curl"
Oct 30 10:56:48.418018 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.417999    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.450436 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.450413    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:48.540518 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.540492    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.540635 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.540556    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425dk\" (UniqueName: \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.540684 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.540630    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.641806 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.641776    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.641926 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.641818    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.641926 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.641864    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425dk\" (UniqueName: \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.642572 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.642550    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.644351 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.644321    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.669063 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.669041    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-425dk\" (UniqueName: \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\") pod \"data-science-collector-targetallocator-65bcc8668-8z29n\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:48.728893 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:48.728872    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:49.024120 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.023990    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:49.026840 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:56:49.026814    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod739c0725_fcec_41ef_9580_ef4b75ced259.slice/crio-7267cf600002ee75b590b82df4d508fdfc4e653d76c86006872d3a9d2fde1a7f WatchSource:0}: Error finding container 7267cf600002ee75b590b82df4d508fdfc4e653d76c86006872d3a9d2fde1a7f: Status 404 returned error can't find the container with id 7267cf600002ee75b590b82df4d508fdfc4e653d76c86006872d3a9d2fde1a7f
Oct 30 10:56:49.029004 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.028958    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:56:49.029106 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.029024    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:56:49.439512 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.439477    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" event={"ID":"739c0725-fcec-41ef-9580-ef4b75ced259","Type":"ContainerStarted","Data":"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"}
Oct 30 10:56:49.439904 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.439520    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" event={"ID":"739c0725-fcec-41ef-9580-ef4b75ced259","Type":"ContainerStarted","Data":"7267cf600002ee75b590b82df4d508fdfc4e653d76c86006872d3a9d2fde1a7f"}
Oct 30 10:56:49.439904 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.439694    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:49.440776 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.440746    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.28:8080/readyz\": dial tcp 10.133.0.28:8080: connect: connection refused"
Oct 30 10:56:49.483284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:49.483246    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" podStartSLOduration=1.483235171 podStartE2EDuration="1.483235171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:56:49.482650204 +0000 UTC m=+705.828242058" watchObservedRunningTime="2026-10-30 10:56:49.483235171 +0000 UTC m=+705.828827024"
Oct 30 10:56:50.444740 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.444715    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:50.516353 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.516313    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:56:50.516519 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.516494    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerName="ta-container" containerID="cri-o://5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10" gracePeriod=30
Oct 30 10:56:50.753273 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.753250    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:56:50.860026 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.859995    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\" (UniqueName: \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\") pod \"6f0f0aeb-1b71-456f-9802-26efaac6be99\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") "
Oct 30 10:56:50.860178 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.860034    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\" (UniqueName: \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\") pod \"6f0f0aeb-1b71-456f-9802-26efaac6be99\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") "
Oct 30 10:56:50.860178 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.860082    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\") pod \"6f0f0aeb-1b71-456f-9802-26efaac6be99\" (UID: \"6f0f0aeb-1b71-456f-9802-26efaac6be99\") "
Oct 30 10:56:50.860447 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.860418    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal" pod "6f0f0aeb-1b71-456f-9802-26efaac6be99" (UID: "6f0f0aeb-1b71-456f-9802-26efaac6be99"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:56:50.862089 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.862056    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf" pod "6f0f0aeb-1b71-456f-9802-26efaac6be99" (UID: "6f0f0aeb-1b71-456f-9802-26efaac6be99"). InnerVolumeSpecName "kube-api-access-hm4vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:56:50.862235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.862091    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert" pod "6f0f0aeb-1b71-456f-9802-26efaac6be99" (UID: "6f0f0aeb-1b71-456f-9802-26efaac6be99"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:56:50.961527 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.961482    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm4vf\" (UniqueName: \"kubernetes.io/projected/6f0f0aeb-1b71-456f-9802-26efaac6be99-kube-api-access-hm4vf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:50.961690 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.961653    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6f0f0aeb-1b71-456f-9802-26efaac6be99-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:50.961788 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:50.961709    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6f0f0aeb-1b71-456f-9802-26efaac6be99-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:51.449275 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.449242    4488 generic.go:356] "Generic (PLEG): container finished" podID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerID="5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10" exitCode=0
Oct 30 10:56:51.449675 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.449300    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"
Oct 30 10:56:51.449675 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.449336    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" event={"ID":"6f0f0aeb-1b71-456f-9802-26efaac6be99","Type":"ContainerDied","Data":"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"}
Oct 30 10:56:51.449675 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.449394    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs" event={"ID":"6f0f0aeb-1b71-456f-9802-26efaac6be99","Type":"ContainerDied","Data":"55cd93c5ffe572bd34583467d24ba30d600b29d9ae2002566c4e16806a827e97"}
Oct 30 10:56:51.449675 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.449416    4488 scope.go:122] "RemoveContainer" containerID="5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"
Oct 30 10:56:51.458078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.458059    4488 scope.go:122] "RemoveContainer" containerID="5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"
Oct 30 10:56:51.458383 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:56:51.458360    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10\": container with ID starting with 5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10 not found: ID does not exist" containerID="5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"
Oct 30 10:56:51.458450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.458391    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10"} err="failed to get container status \"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10\": rpc error: code = NotFound desc = could not find container \"5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10\": container with ID starting with 5b1a746584b6d6e0aa9d525fc13e605e7e2993219fb270d3d3e1fc5b2c6ffd10 not found: ID does not exist"
Oct 30 10:56:51.504530 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.504509    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:56:51.518475 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.518453    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc8465767-g4tfs"]
Oct 30 10:56:51.803204 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:51.803110    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" path="/var/lib/kubelet/pods/6f0f0aeb-1b71-456f-9802-26efaac6be99/volumes"
Oct 30 10:56:57.388443 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.388413    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:56:57.388883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.388731    4488 cpu_manager.go:414] "containerMap: removing container" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerName="ta-container"
Oct 30 10:56:57.388883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.388742    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerName="ta-container"
Oct 30 10:56:57.388883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.388807    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f0f0aeb-1b71-456f-9802-26efaac6be99" containerName="ta-container"
Oct 30 10:56:57.392949 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.392933    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.410278 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.410249    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:56:57.509449 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.509420    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.509585 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.509486    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fqk\" (UniqueName: \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.509630 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.509585    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.610839 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.610812    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fqk\" (UniqueName: \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.610975 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.610844    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.610975 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.610881    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.611538 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.611511    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.613288 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.613268    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.635365 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.635306    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fqk\" (UniqueName: \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\") pod \"data-science-collector-targetallocator-8645c84745-bd6nr\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:57.703257 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:57.703232    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:58.000788 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.000762    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:56:58.003127 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:56:58.003094    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01d63639_7e6a_4d2e_819f_7e2a5e6fb118.slice/crio-a4cbb776ba8d722e1fa5a3d79cd94891667053b0ff3937b1b334705c61775734 WatchSource:0}: Error finding container a4cbb776ba8d722e1fa5a3d79cd94891667053b0ff3937b1b334705c61775734: Status 404 returned error can't find the container with id a4cbb776ba8d722e1fa5a3d79cd94891667053b0ff3937b1b334705c61775734
Oct 30 10:56:58.005180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.005149    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:56:58.005254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.005207    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:56:58.477949 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.477916    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" event={"ID":"01d63639-7e6a-4d2e-819f-7e2a5e6fb118","Type":"ContainerStarted","Data":"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"}
Oct 30 10:56:58.477949 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.477957    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" event={"ID":"01d63639-7e6a-4d2e-819f-7e2a5e6fb118","Type":"ContainerStarted","Data":"a4cbb776ba8d722e1fa5a3d79cd94891667053b0ff3937b1b334705c61775734"}
Oct 30 10:56:58.478441 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.478131    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:58.479635 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.479615    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:56:58.521849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.521805    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" podStartSLOduration=1.521792457 podStartE2EDuration="1.521792457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:56:58.521252575 +0000 UTC m=+714.866844440" watchObservedRunningTime="2026-10-30 10:56:58.521792457 +0000 UTC m=+714.867384310"
Oct 30 10:56:58.597258 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.597223    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:58.597486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.597461    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" containerName="ta-container" containerID="cri-o://2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447" gracePeriod=30
Oct 30 10:56:58.833605 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.833584    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:58.923309 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.923281    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\") pod \"739c0725-fcec-41ef-9580-ef4b75ced259\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") "
Oct 30 10:56:58.923464 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.923314    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\" (UniqueName: \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\") pod \"739c0725-fcec-41ef-9580-ef4b75ced259\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") "
Oct 30 10:56:58.923464 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.923333    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\" (UniqueName: \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\") pod \"739c0725-fcec-41ef-9580-ef4b75ced259\" (UID: \"739c0725-fcec-41ef-9580-ef4b75ced259\") "
Oct 30 10:56:58.923791 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.923764    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal" pod "739c0725-fcec-41ef-9580-ef4b75ced259" (UID: "739c0725-fcec-41ef-9580-ef4b75ced259"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:56:58.925448 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.925423    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk" pod "739c0725-fcec-41ef-9580-ef4b75ced259" (UID: "739c0725-fcec-41ef-9580-ef4b75ced259"). InnerVolumeSpecName "kube-api-access-425dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:56:58.925559 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:58.925544    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert" pod "739c0725-fcec-41ef-9580-ef4b75ced259" (UID: "739c0725-fcec-41ef-9580-ef4b75ced259"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:56:59.024686 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.024632    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/739c0725-fcec-41ef-9580-ef4b75ced259-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:59.024686 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.024654    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-425dk\" (UniqueName: \"kubernetes.io/projected/739c0725-fcec-41ef-9580-ef4b75ced259-kube-api-access-425dk\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:59.024686 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.024665    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/739c0725-fcec-41ef-9580-ef4b75ced259-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:56:59.483386 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.483326    4488 generic.go:356] "Generic (PLEG): container finished" podID="739c0725-fcec-41ef-9580-ef4b75ced259" containerID="2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447" exitCode=0
Oct 30 10:56:59.483772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.483396    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"
Oct 30 10:56:59.483772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.483415    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" event={"ID":"739c0725-fcec-41ef-9580-ef4b75ced259","Type":"ContainerDied","Data":"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"}
Oct 30 10:56:59.483772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.483470    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n" event={"ID":"739c0725-fcec-41ef-9580-ef4b75ced259","Type":"ContainerDied","Data":"7267cf600002ee75b590b82df4d508fdfc4e653d76c86006872d3a9d2fde1a7f"}
Oct 30 10:56:59.483772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.483492    4488 scope.go:122] "RemoveContainer" containerID="2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"
Oct 30 10:56:59.492214 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.492199    4488 scope.go:122] "RemoveContainer" containerID="2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"
Oct 30 10:56:59.492515 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:56:59.492491    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447\": container with ID starting with 2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447 not found: ID does not exist" containerID="2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"
Oct 30 10:56:59.492598 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.492521    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447"} err="failed to get container status \"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447\": rpc error: code = NotFound desc = could not find container \"2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447\": container with ID starting with 2f0cfda93afe98a66bdc183debc4b44ef94bbe969d96ec0664825e8624c2c447 not found: ID does not exist"
Oct 30 10:56:59.539289 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.539265    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:59.543058 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.543040    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65bcc8668-8z29n"]
Oct 30 10:56:59.806782 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:56:59.806717    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" path="/var/lib/kubelet/pods/739c0725-fcec-41ef-9580-ef4b75ced259/volumes"
Oct 30 10:57:01.478147 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:01.478110    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:57:06.437166 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.437133    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:06.437616 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.437422    4488 cpu_manager.go:414] "containerMap: removing container" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" containerName="ta-container"
Oct 30 10:57:06.437616 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.437433    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" containerName="ta-container"
Oct 30 10:57:06.437616 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.437502    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="739c0725-fcec-41ef-9580-ef4b75ced259" containerName="ta-container"
Oct 30 10:57:06.441235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.441216    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.472272 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.472247    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:06.577782 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.577753    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.577900 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.577811    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48hs\" (UniqueName: \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.577944 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.577919    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.679075 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.679045    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.679244 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.679100    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48hs\" (UniqueName: \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.679244 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.679130    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.679782 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.679761    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.681354 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.681322    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.703882 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.703833    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48hs\" (UniqueName: \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\") pod \"data-science-collector-targetallocator-66c5cbd7f8-qpqg8\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:06.751983 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:06.751962    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:07.047796 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.047709    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:07.049972 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:07.049939    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8bb7652_e3b3_4d48_9825_ef7db4f15b55.slice/crio-c9ac034c4955d48e8dad83b14915bd9921bac1b796fe9986ee2583a1a48ca79c WatchSource:0}: Error finding container c9ac034c4955d48e8dad83b14915bd9921bac1b796fe9986ee2583a1a48ca79c: Status 404 returned error can't find the container with id c9ac034c4955d48e8dad83b14915bd9921bac1b796fe9986ee2583a1a48ca79c
Oct 30 10:57:07.052165 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.052132    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:07.052267 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.052187    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:07.515772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.515732    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" event={"ID":"e8bb7652-e3b3-4d48-9825-ef7db4f15b55","Type":"ContainerStarted","Data":"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"}
Oct 30 10:57:07.515772 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.515775    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" event={"ID":"e8bb7652-e3b3-4d48-9825-ef7db4f15b55","Type":"ContainerStarted","Data":"c9ac034c4955d48e8dad83b14915bd9921bac1b796fe9986ee2583a1a48ca79c"}
Oct 30 10:57:07.516437 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.515877    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:07.517443 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.517423    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:07.560601 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.560562    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" podStartSLOduration=1.560550431 podStartE2EDuration="1.560550431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:07.559697638 +0000 UTC m=+723.905289491" watchObservedRunningTime="2026-10-30 10:57:07.560550431 +0000 UTC m=+723.906142341"
Oct 30 10:57:07.634204 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.634166    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:57:07.634379 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.634355    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" podUID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" containerName="ta-container" containerID="cri-o://61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71" gracePeriod=30
Oct 30 10:57:07.865187 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.865163    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:57:07.992496 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.992463    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\" (UniqueName: \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\") pod \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") "
Oct 30 10:57:07.992640 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.992546    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\" (UniqueName: \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\") pod \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") "
Oct 30 10:57:07.992640 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.992584    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\") pod \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\" (UID: \"01d63639-7e6a-4d2e-819f-7e2a5e6fb118\") "
Oct 30 10:57:07.992937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.992913    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal" pod "01d63639-7e6a-4d2e-819f-7e2a5e6fb118" (UID: "01d63639-7e6a-4d2e-819f-7e2a5e6fb118"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:07.994523 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.994499    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert" pod "01d63639-7e6a-4d2e-819f-7e2a5e6fb118" (UID: "01d63639-7e6a-4d2e-819f-7e2a5e6fb118"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:07.994623 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:07.994589    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk" pod "01d63639-7e6a-4d2e-819f-7e2a5e6fb118" (UID: "01d63639-7e6a-4d2e-819f-7e2a5e6fb118"). InnerVolumeSpecName "kube-api-access-t9fqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:08.093891 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.093841    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9fqk\" (UniqueName: \"kubernetes.io/projected/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-kube-api-access-t9fqk\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:08.093891 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.093868    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:08.093891 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.093885    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/01d63639-7e6a-4d2e-819f-7e2a5e6fb118-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:08.524459 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.524431    4488 generic.go:356] "Generic (PLEG): container finished" podID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" containerID="61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71" exitCode=0
Oct 30 10:57:08.524846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.524480    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"
Oct 30 10:57:08.524846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.524512    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" event={"ID":"01d63639-7e6a-4d2e-819f-7e2a5e6fb118","Type":"ContainerDied","Data":"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"}
Oct 30 10:57:08.524846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.524545    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr" event={"ID":"01d63639-7e6a-4d2e-819f-7e2a5e6fb118","Type":"ContainerDied","Data":"a4cbb776ba8d722e1fa5a3d79cd94891667053b0ff3937b1b334705c61775734"}
Oct 30 10:57:08.524846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.524564    4488 scope.go:122] "RemoveContainer" containerID="61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"
Oct 30 10:57:08.536688 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.536671    4488 scope.go:122] "RemoveContainer" containerID="61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"
Oct 30 10:57:08.536961 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:08.536944    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71\": container with ID starting with 61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71 not found: ID does not exist" containerID="61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"
Oct 30 10:57:08.537010 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.536971    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71"} err="failed to get container status \"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71\": rpc error: code = NotFound desc = could not find container \"61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71\": container with ID starting with 61309e6e3e1033fce7ad607899c463809d46c5d332c7ec1c31d4d091700fca71 not found: ID does not exist"
Oct 30 10:57:08.579184 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.579158    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:57:08.583105 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:08.583084    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8645c84745-bd6nr"]
Oct 30 10:57:09.801515 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:09.801487    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" path="/var/lib/kubelet/pods/01d63639-7e6a-4d2e-819f-7e2a5e6fb118/volumes"
Oct 30 10:57:14.730213 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.730172    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:14.730693 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.730676    4488 cpu_manager.go:414] "containerMap: removing container" podUID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" containerName="ta-container"
Oct 30 10:57:14.730736 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.730696    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" containerName="ta-container"
Oct 30 10:57:14.730788 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.730778    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="01d63639-7e6a-4d2e-819f-7e2a5e6fb118" containerName="ta-container"
Oct 30 10:57:14.735910 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.735886    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.741631 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.741607    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h8q2\" (UniqueName: \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.741762 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.741662    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.741762 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.741687    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.752680 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.752657    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:14.842207 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.842175    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h8q2\" (UniqueName: \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.842337 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.842229    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.842337 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.842251    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.842915 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.842885    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.844574 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.844549    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:14.866700 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:14.866670    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h8q2\" (UniqueName: \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\") pod \"data-science-collector-targetallocator-6bccb8f995-pkcgl\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:15.047827 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.047754    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:15.342437 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.342371    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:15.345539 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:15.345513    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dff3200_7eed_45ef_9f33_f6fc7f28f0ff.slice/crio-fe8819ee9a3fa97fcd4a1e3f5bafa3aaa91f4ae2a63c3a444c4d2dc16458bccb WatchSource:0}: Error finding container fe8819ee9a3fa97fcd4a1e3f5bafa3aaa91f4ae2a63c3a444c4d2dc16458bccb: Status 404 returned error can't find the container with id fe8819ee9a3fa97fcd4a1e3f5bafa3aaa91f4ae2a63c3a444c4d2dc16458bccb
Oct 30 10:57:15.347949 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.347919    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:15.348055 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.347972    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:15.555419 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.555381    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" event={"ID":"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff","Type":"ContainerStarted","Data":"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"}
Oct 30 10:57:15.555419 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.555430    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" event={"ID":"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff","Type":"ContainerStarted","Data":"fe8819ee9a3fa97fcd4a1e3f5bafa3aaa91f4ae2a63c3a444c4d2dc16458bccb"}
Oct 30 10:57:15.555679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.555515    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:15.556625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.556597    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.31:8080/readyz\": dial tcp 10.133.0.31:8080: connect: connection refused"
Oct 30 10:57:15.599630 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:15.599560    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" podStartSLOduration=1.599547684 podStartE2EDuration="1.599547684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:15.598765818 +0000 UTC m=+731.944357676" watchObservedRunningTime="2026-10-30 10:57:15.599547684 +0000 UTC m=+731.945139596"
Oct 30 10:57:16.560422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.560398    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:16.634828 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.634796    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:16.634978 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.634958    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" podUID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" containerName="ta-container" containerID="cri-o://da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35" gracePeriod=30
Oct 30 10:57:16.870453 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.870428    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:16.956746 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.956715    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\" (UniqueName: \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\") pod \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") "
Oct 30 10:57:16.956840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.956765    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\") pod \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") "
Oct 30 10:57:16.956915 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.956899    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\" (UniqueName: \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\") pod \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\" (UID: \"e8bb7652-e3b3-4d48-9825-ef7db4f15b55\") "
Oct 30 10:57:16.957107 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.957080    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal" pod "e8bb7652-e3b3-4d48-9825-ef7db4f15b55" (UID: "e8bb7652-e3b3-4d48-9825-ef7db4f15b55"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:16.958714 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.958690    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert" pod "e8bb7652-e3b3-4d48-9825-ef7db4f15b55" (UID: "e8bb7652-e3b3-4d48-9825-ef7db4f15b55"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:16.958840 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:16.958813    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs" pod "e8bb7652-e3b3-4d48-9825-ef7db4f15b55" (UID: "e8bb7652-e3b3-4d48-9825-ef7db4f15b55"). InnerVolumeSpecName "kube-api-access-j48hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:17.058033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.058007    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j48hs\" (UniqueName: \"kubernetes.io/projected/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-kube-api-access-j48hs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:17.058033 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.058029    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:17.058201 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.058040    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e8bb7652-e3b3-4d48-9825-ef7db4f15b55-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:17.564976 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.564944    4488 generic.go:356] "Generic (PLEG): container finished" podID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" containerID="da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35" exitCode=0
Oct 30 10:57:17.565486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.565000    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"
Oct 30 10:57:17.565486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.565035    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" event={"ID":"e8bb7652-e3b3-4d48-9825-ef7db4f15b55","Type":"ContainerDied","Data":"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"}
Oct 30 10:57:17.565486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.565076    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8" event={"ID":"e8bb7652-e3b3-4d48-9825-ef7db4f15b55","Type":"ContainerDied","Data":"c9ac034c4955d48e8dad83b14915bd9921bac1b796fe9986ee2583a1a48ca79c"}
Oct 30 10:57:17.565486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.565093    4488 scope.go:122] "RemoveContainer" containerID="da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"
Oct 30 10:57:17.573730 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.573713    4488 scope.go:122] "RemoveContainer" containerID="da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"
Oct 30 10:57:17.573978 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:17.573958    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35\": container with ID starting with da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35 not found: ID does not exist" containerID="da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"
Oct 30 10:57:17.574020 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.573987    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35"} err="failed to get container status \"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35\": rpc error: code = NotFound desc = could not find container \"da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35\": container with ID starting with da73c05816700ab6df51f48d09931d192e099e11c3624538416863bef0198b35 not found: ID does not exist"
Oct 30 10:57:17.619411 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.619388    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:17.633310 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.633289    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66c5cbd7f8-qpqg8"]
Oct 30 10:57:17.801596 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:17.801574    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" path="/var/lib/kubelet/pods/e8bb7652-e3b3-4d48-9825-ef7db4f15b55/volumes"
Oct 30 10:57:22.696910 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.696881    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:22.697283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.697158    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" containerName="ta-container"
Oct 30 10:57:22.697283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.697168    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" containerName="ta-container"
Oct 30 10:57:22.697283 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.697230    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8bb7652-e3b3-4d48-9825-ef7db4f15b55" containerName="ta-container"
Oct 30 10:57:22.700095 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.700079    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.751985 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.751964    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:22.795229 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.795200    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.795375 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.795239    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.795375 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.795331    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrmb\" (UniqueName: \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.896302 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.896274    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.896435 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.896315    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.896435 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.896391    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrmb\" (UniqueName: \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.896966 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.896943    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.898714 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.898692    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:22.921030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:22.921001    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrmb\" (UniqueName: \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\") pod \"data-science-collector-targetallocator-5bbb5d697f-pqjlh\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:23.010626 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.010570    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:23.305581 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.305505    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:23.307656 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:23.307625    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod973c0835_0409_450e_8ec1_335cc028e076.slice/crio-d186c66531c784f6e2f5d663fb4f69990bfbec97ff8bc819dbda1503bcc5e30e WatchSource:0}: Error finding container d186c66531c784f6e2f5d663fb4f69990bfbec97ff8bc819dbda1503bcc5e30e: Status 404 returned error can't find the container with id d186c66531c784f6e2f5d663fb4f69990bfbec97ff8bc819dbda1503bcc5e30e
Oct 30 10:57:23.309754 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.309719    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:23.309859 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.309776    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:23.590415 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.590310    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" event={"ID":"973c0835-0409-450e-8ec1-335cc028e076","Type":"ContainerStarted","Data":"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"}
Oct 30 10:57:23.590415 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.590370    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" event={"ID":"973c0835-0409-450e-8ec1-335cc028e076","Type":"ContainerStarted","Data":"d186c66531c784f6e2f5d663fb4f69990bfbec97ff8bc819dbda1503bcc5e30e"}
Oct 30 10:57:23.590415 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.590393    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:23.591254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.591232    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" podUID="973c0835-0409-450e-8ec1-335cc028e076" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.32:8080/readyz\": dial tcp 10.133.0.32:8080: connect: connection refused"
Oct 30 10:57:23.636783 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:23.636737    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" podStartSLOduration=1.636723498 podStartE2EDuration="1.636723498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:23.635785752 +0000 UTC m=+739.981377606" watchObservedRunningTime="2026-10-30 10:57:23.636723498 +0000 UTC m=+739.982315351"
Oct 30 10:57:24.597971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:24.597941    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:24.675274 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:24.675244    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:24.675498 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:24.675458    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerName="ta-container" containerID="cri-o://78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59" gracePeriod=30
Oct 30 10:57:24.908696 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:24.908668    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:25.013711 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.013680    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\") pod \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") "
Oct 30 10:57:25.013711 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.013714    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\" (UniqueName: \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\") pod \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") "
Oct 30 10:57:25.013905 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.013736    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\") pod \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\" (UID: \"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff\") "
Oct 30 10:57:25.014110 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.014084    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal" pod "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" (UID: "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:25.015669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.015650    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2" pod "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" (UID: "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff"). InnerVolumeSpecName "kube-api-access-8h8q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:25.015750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.015676    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert" pod "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" (UID: "0dff3200-7eed-45ef-9f33-f6fc7f28f0ff"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:25.114306 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.114282    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:25.114306 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.114302    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h8q2\" (UniqueName: \"kubernetes.io/projected/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-kube-api-access-8h8q2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:25.114458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.114312    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:25.602127 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.602095    4488 generic.go:356] "Generic (PLEG): container finished" podID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerID="78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59" exitCode=0
Oct 30 10:57:25.602541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.602141    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"
Oct 30 10:57:25.602541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.602175    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" event={"ID":"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff","Type":"ContainerDied","Data":"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"}
Oct 30 10:57:25.602541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.602222    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl" event={"ID":"0dff3200-7eed-45ef-9f33-f6fc7f28f0ff","Type":"ContainerDied","Data":"fe8819ee9a3fa97fcd4a1e3f5bafa3aaa91f4ae2a63c3a444c4d2dc16458bccb"}
Oct 30 10:57:25.602541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.602244    4488 scope.go:122] "RemoveContainer" containerID="78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"
Oct 30 10:57:25.611233 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.611216    4488 scope.go:122] "RemoveContainer" containerID="78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"
Oct 30 10:57:25.611524 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:25.611502    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59\": container with ID starting with 78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59 not found: ID does not exist" containerID="78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"
Oct 30 10:57:25.611578 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.611538    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59"} err="failed to get container status \"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59\": rpc error: code = NotFound desc = could not find container \"78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59\": container with ID starting with 78b29bdbbad7f7e18024a12d2debbf90e3d89d362c2b7d5ab4d3890bd2031e59 not found: ID does not exist"
Oct 30 10:57:25.657149 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.657128    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:25.671766 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.671745    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bccb8f995-pkcgl"]
Oct 30 10:57:25.802017 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:25.801988    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" path="/var/lib/kubelet/pods/0dff3200-7eed-45ef-9f33-f6fc7f28f0ff/volumes"
Oct 30 10:57:30.512706 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.512665    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:30.513143 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.513093    4488 cpu_manager.go:414] "containerMap: removing container" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerName="ta-container"
Oct 30 10:57:30.513143 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.513112    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerName="ta-container"
Oct 30 10:57:30.513274 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.513215    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="0dff3200-7eed-45ef-9f33-f6fc7f28f0ff" containerName="ta-container"
Oct 30 10:57:30.517123 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.517103    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.534168 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.534145    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:30.652437 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.652406    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.652562 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.652444    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.652562 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.652528    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszk8\" (UniqueName: \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.752887 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.752859    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.752999 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.752896    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.752999 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.752933    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszk8\" (UniqueName: \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.753875 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.753853    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.755348 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.755317    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.780066 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.780009    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszk8\" (UniqueName: \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\") pod \"data-science-collector-targetallocator-79c479c458-tvzwj\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:30.827194 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:30.827171    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:31.124166 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.124142    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:31.126668 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:31.126637    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ece499f_80a2_4a67_8123_18d0c0fb8abf.slice/crio-2fe61391e741e0a48b0cc844c9b6dfdf597075f20f1fd9287f9ab9abfade00b2 WatchSource:0}: Error finding container 2fe61391e741e0a48b0cc844c9b6dfdf597075f20f1fd9287f9ab9abfade00b2: Status 404 returned error can't find the container with id 2fe61391e741e0a48b0cc844c9b6dfdf597075f20f1fd9287f9ab9abfade00b2
Oct 30 10:57:31.129124 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.129092    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:31.129212 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.129148    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:31.478791 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:31.478757    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:57:31.628849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.628816    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" event={"ID":"3ece499f-80a2-4a67-8123-18d0c0fb8abf","Type":"ContainerStarted","Data":"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"}
Oct 30 10:57:31.628849 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.628853    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" event={"ID":"3ece499f-80a2-4a67-8123-18d0c0fb8abf","Type":"ContainerStarted","Data":"2fe61391e741e0a48b0cc844c9b6dfdf597075f20f1fd9287f9ab9abfade00b2"}
Oct 30 10:57:31.629250 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.628967    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:31.630411 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.630395    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:31.674028 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.673983    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" podStartSLOduration=1.67397006 podStartE2EDuration="1.67397006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:31.672806927 +0000 UTC m=+748.018398782" watchObservedRunningTime="2026-10-30 10:57:31.67397006 +0000 UTC m=+748.019561914"
Oct 30 10:57:31.745520 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.745453    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:31.745700 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.745674    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" podUID="973c0835-0409-450e-8ec1-335cc028e076" containerName="ta-container" containerID="cri-o://d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627" gracePeriod=30
Oct 30 10:57:31.983163 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:31.983140    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:32.064140 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.064080    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\") pod \"973c0835-0409-450e-8ec1-335cc028e076\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") "
Oct 30 10:57:32.064272 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.064184    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\" (UniqueName: \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\") pod \"973c0835-0409-450e-8ec1-335cc028e076\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") "
Oct 30 10:57:32.064272 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.064218    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\" (UniqueName: \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\") pod \"973c0835-0409-450e-8ec1-335cc028e076\" (UID: \"973c0835-0409-450e-8ec1-335cc028e076\") "
Oct 30 10:57:32.064745 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.064723    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal" pod "973c0835-0409-450e-8ec1-335cc028e076" (UID: "973c0835-0409-450e-8ec1-335cc028e076"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:32.066072 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.066053    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert" pod "973c0835-0409-450e-8ec1-335cc028e076" (UID: "973c0835-0409-450e-8ec1-335cc028e076"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:32.066303 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.066284    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb" pod "973c0835-0409-450e-8ec1-335cc028e076" (UID: "973c0835-0409-450e-8ec1-335cc028e076"). InnerVolumeSpecName "kube-api-access-9vrmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:32.165420 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.165395    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/973c0835-0409-450e-8ec1-335cc028e076-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:32.165420 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.165419    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/973c0835-0409-450e-8ec1-335cc028e076-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:32.165544 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.165433    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vrmb\" (UniqueName: \"kubernetes.io/projected/973c0835-0409-450e-8ec1-335cc028e076-kube-api-access-9vrmb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:32.633710 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.633680    4488 generic.go:356] "Generic (PLEG): container finished" podID="973c0835-0409-450e-8ec1-335cc028e076" containerID="d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627" exitCode=0
Oct 30 10:57:32.634114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.633735    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"
Oct 30 10:57:32.634114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.633767    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" event={"ID":"973c0835-0409-450e-8ec1-335cc028e076","Type":"ContainerDied","Data":"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"}
Oct 30 10:57:32.634114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.633816    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh" event={"ID":"973c0835-0409-450e-8ec1-335cc028e076","Type":"ContainerDied","Data":"d186c66531c784f6e2f5d663fb4f69990bfbec97ff8bc819dbda1503bcc5e30e"}
Oct 30 10:57:32.634114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.633834    4488 scope.go:122] "RemoveContainer" containerID="d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"
Oct 30 10:57:32.642672 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.642650    4488 scope.go:122] "RemoveContainer" containerID="d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"
Oct 30 10:57:32.642935 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:32.642919    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627\": container with ID starting with d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627 not found: ID does not exist" containerID="d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"
Oct 30 10:57:32.642987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.642941    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627"} err="failed to get container status \"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627\": rpc error: code = NotFound desc = could not find container \"d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627\": container with ID starting with d24269b18109ddc727a5665dfb5c3fb2a732c4ba38c07d8dbeeb46c5b7bb9627 not found: ID does not exist"
Oct 30 10:57:32.688320 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.688298    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:32.702474 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:32.702452    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bbb5d697f-pqjlh"]
Oct 30 10:57:33.801949 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:33.801919    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="973c0835-0409-450e-8ec1-335cc028e076" path="/var/lib/kubelet/pods/973c0835-0409-450e-8ec1-335cc028e076/volumes"
Oct 30 10:57:38.732024 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.731990    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:38.732509 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.732267    4488 cpu_manager.go:414] "containerMap: removing container" podUID="973c0835-0409-450e-8ec1-335cc028e076" containerName="ta-container"
Oct 30 10:57:38.732509 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.732278    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="973c0835-0409-450e-8ec1-335cc028e076" containerName="ta-container"
Oct 30 10:57:38.732509 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.732355    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="973c0835-0409-450e-8ec1-335cc028e076" containerName="ta-container"
Oct 30 10:57:38.736395 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.736378    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:38.756465 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.756437    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:38.911322 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.911293    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2679q\" (UniqueName: \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:38.911474 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.911328    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:38.911474 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:38.911458    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.012326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.012263    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2679q\" (UniqueName: \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.012326 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.012296    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.012485 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.012354    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.012884 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.012864    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.014725 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.014705    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.036857 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.036835    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2679q\" (UniqueName: \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\") pod \"data-science-collector-targetallocator-c5cf4bdf7-hxdrs\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.048150 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.048132    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.343421 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.343329    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:39.346687 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:39.346660    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfde3fa89_d9a7_44b8_8564_d26b772c8b78.slice/crio-576a13c082b2fc4117e4ff54e3d3aec43795a7feb14a332a095b50a796bd6f1d WatchSource:0}: Error finding container 576a13c082b2fc4117e4ff54e3d3aec43795a7feb14a332a095b50a796bd6f1d: Status 404 returned error can't find the container with id 576a13c082b2fc4117e4ff54e3d3aec43795a7feb14a332a095b50a796bd6f1d
Oct 30 10:57:39.348657 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.348626    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:39.348734 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.348680    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:39.663852 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.663775    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" event={"ID":"fde3fa89-d9a7-44b8-8564-d26b772c8b78","Type":"ContainerStarted","Data":"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"}
Oct 30 10:57:39.663852 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.663813    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" event={"ID":"fde3fa89-d9a7-44b8-8564-d26b772c8b78","Type":"ContainerStarted","Data":"576a13c082b2fc4117e4ff54e3d3aec43795a7feb14a332a095b50a796bd6f1d"}
Oct 30 10:57:39.664069 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.663985    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:39.664905 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.664881    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.34:8080/readyz\": dial tcp 10.133.0.34:8080: connect: connection refused"
Oct 30 10:57:39.709262 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:39.709220    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" podStartSLOduration=1.709207364 podStartE2EDuration="1.709207364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:39.708278346 +0000 UTC m=+756.053870214" watchObservedRunningTime="2026-10-30 10:57:39.709207364 +0000 UTC m=+756.054799215"
Oct 30 10:57:40.668078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:40.668047    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:40.746717 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:40.746685    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:40.746943 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:40.746901    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" podUID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" containerName="ta-container" containerID="cri-o://63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970" gracePeriod=30
Oct 30 10:57:40.984613 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:40.984592    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:41.132742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.132711    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\") pod \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") "
Oct 30 10:57:41.132890 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.132802    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\" (UniqueName: \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\") pod \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") "
Oct 30 10:57:41.132933 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.132897    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\") pod \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\" (UID: \"3ece499f-80a2-4a67-8123-18d0c0fb8abf\") "
Oct 30 10:57:41.133124 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.133101    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal" pod "3ece499f-80a2-4a67-8123-18d0c0fb8abf" (UID: "3ece499f-80a2-4a67-8123-18d0c0fb8abf"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:41.133206 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.133170    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3ece499f-80a2-4a67-8123-18d0c0fb8abf-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:41.134761 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.134744    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert" pod "3ece499f-80a2-4a67-8123-18d0c0fb8abf" (UID: "3ece499f-80a2-4a67-8123-18d0c0fb8abf"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:41.134886 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.134867    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8" pod "3ece499f-80a2-4a67-8123-18d0c0fb8abf" (UID: "3ece499f-80a2-4a67-8123-18d0c0fb8abf"). InnerVolumeSpecName "kube-api-access-pszk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:41.234009 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.233958    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszk8\" (UniqueName: \"kubernetes.io/projected/3ece499f-80a2-4a67-8123-18d0c0fb8abf-kube-api-access-pszk8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:41.234009 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.233980    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3ece499f-80a2-4a67-8123-18d0c0fb8abf-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:41.672225 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.672192    4488 generic.go:356] "Generic (PLEG): container finished" podID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" containerID="63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970" exitCode=0
Oct 30 10:57:41.672612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.672240    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"
Oct 30 10:57:41.672612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.672278    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" event={"ID":"3ece499f-80a2-4a67-8123-18d0c0fb8abf","Type":"ContainerDied","Data":"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"}
Oct 30 10:57:41.672612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.672320    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj" event={"ID":"3ece499f-80a2-4a67-8123-18d0c0fb8abf","Type":"ContainerDied","Data":"2fe61391e741e0a48b0cc844c9b6dfdf597075f20f1fd9287f9ab9abfade00b2"}
Oct 30 10:57:41.672612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.672364    4488 scope.go:122] "RemoveContainer" containerID="63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"
Oct 30 10:57:41.680508 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.680492    4488 scope.go:122] "RemoveContainer" containerID="63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"
Oct 30 10:57:41.680766 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:41.680750    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970\": container with ID starting with 63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970 not found: ID does not exist" containerID="63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"
Oct 30 10:57:41.680842 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.680772    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970"} err="failed to get container status \"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970\": rpc error: code = NotFound desc = could not find container \"63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970\": container with ID starting with 63ad941bdd5d0a599065732e81858e16e026001f5111388c961758880e2e8970 not found: ID does not exist"
Oct 30 10:57:41.727687 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.727651    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:41.740793 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.740770    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-79c479c458-tvzwj"]
Oct 30 10:57:41.801946 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:41.801919    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" path="/var/lib/kubelet/pods/3ece499f-80a2-4a67-8123-18d0c0fb8abf/volumes"
Oct 30 10:57:47.395058 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.394979    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:47.395424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.395272    4488 cpu_manager.go:414] "containerMap: removing container" podUID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" containerName="ta-container"
Oct 30 10:57:47.395424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.395283    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" containerName="ta-container"
Oct 30 10:57:47.395424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.395336    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ece499f-80a2-4a67-8123-18d0c0fb8abf" containerName="ta-container"
Oct 30 10:57:47.399486 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.399469    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.416527 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.416499    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:47.475156 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.475124    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.475296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.475172    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.475296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.475263    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hm2\" (UniqueName: \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.575598 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.575569    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.575720 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.575610    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.575720 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.575659    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hm2\" (UniqueName: \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.576174 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.576155    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.578036 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.578016    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.603005 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.602976    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hm2\" (UniqueName: \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\") pod \"data-science-collector-targetallocator-55766888fb-8r7vd\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:47.710636 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:47.710613    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:48.007920 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.007896    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:48.010255 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:48.010229    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96eddfa8_c105_4b33_83b5_4832f1871983.slice/crio-6a732974900a76a6e02f83027398f1a9747868b239c8a0b4da26cfaa2cac5e58 WatchSource:0}: Error finding container 6a732974900a76a6e02f83027398f1a9747868b239c8a0b4da26cfaa2cac5e58: Status 404 returned error can't find the container with id 6a732974900a76a6e02f83027398f1a9747868b239c8a0b4da26cfaa2cac5e58
Oct 30 10:57:48.012380 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.012325    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:48.012466 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.012405    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:48.702940 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.702906    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" event={"ID":"96eddfa8-c105-4b33-83b5-4832f1871983","Type":"ContainerStarted","Data":"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"}
Oct 30 10:57:48.703325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.702946    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" event={"ID":"96eddfa8-c105-4b33-83b5-4832f1871983","Type":"ContainerStarted","Data":"6a732974900a76a6e02f83027398f1a9747868b239c8a0b4da26cfaa2cac5e58"}
Oct 30 10:57:48.703325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.703118    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:48.704742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.704720    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:48.747017 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.746975    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" podStartSLOduration=1.7469632069999999 podStartE2EDuration="1.746963207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:48.746506908 +0000 UTC m=+765.092098766" watchObservedRunningTime="2026-10-30 10:57:48.746963207 +0000 UTC m=+765.092555060"
Oct 30 10:57:48.819720 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.819697    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:48.819889 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:48.819853    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerName="ta-container" containerID="cri-o://4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898" gracePeriod=30
Oct 30 10:57:49.057234 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.057213    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:49.087275 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.087246    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\" (UniqueName: \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\") pod \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") "
Oct 30 10:57:49.087424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.087291    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\" (UniqueName: \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\") pod \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") "
Oct 30 10:57:49.087424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.087335    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\") pod \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\" (UID: \"fde3fa89-d9a7-44b8-8564-d26b772c8b78\") "
Oct 30 10:57:49.087573 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.087553    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal" pod "fde3fa89-d9a7-44b8-8564-d26b772c8b78" (UID: "fde3fa89-d9a7-44b8-8564-d26b772c8b78"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:49.089235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.089214    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert" pod "fde3fa89-d9a7-44b8-8564-d26b772c8b78" (UID: "fde3fa89-d9a7-44b8-8564-d26b772c8b78"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:49.089290 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.089215    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q" pod "fde3fa89-d9a7-44b8-8564-d26b772c8b78" (UID: "fde3fa89-d9a7-44b8-8564-d26b772c8b78"). InnerVolumeSpecName "kube-api-access-2679q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:49.188222 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.188196    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fde3fa89-d9a7-44b8-8564-d26b772c8b78-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:49.188222 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.188217    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2679q\" (UniqueName: \"kubernetes.io/projected/fde3fa89-d9a7-44b8-8564-d26b772c8b78-kube-api-access-2679q\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:49.188400 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.188229    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fde3fa89-d9a7-44b8-8564-d26b772c8b78-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:49.708633 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.708595    4488 generic.go:356] "Generic (PLEG): container finished" podID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerID="4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898" exitCode=0
Oct 30 10:57:49.709179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.708647    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"
Oct 30 10:57:49.709179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.708679    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" event={"ID":"fde3fa89-d9a7-44b8-8564-d26b772c8b78","Type":"ContainerDied","Data":"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"}
Oct 30 10:57:49.709179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.708725    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs" event={"ID":"fde3fa89-d9a7-44b8-8564-d26b772c8b78","Type":"ContainerDied","Data":"576a13c082b2fc4117e4ff54e3d3aec43795a7feb14a332a095b50a796bd6f1d"}
Oct 30 10:57:49.709179 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.708742    4488 scope.go:122] "RemoveContainer" containerID="4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"
Oct 30 10:57:49.717163 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.717145    4488 scope.go:122] "RemoveContainer" containerID="4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"
Oct 30 10:57:49.717464 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:49.717445    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898\": container with ID starting with 4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898 not found: ID does not exist" containerID="4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"
Oct 30 10:57:49.717527 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.717475    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898"} err="failed to get container status \"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898\": rpc error: code = NotFound desc = could not find container \"4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898\": container with ID starting with 4704a2cfe15c3e1ca971e57ed466e879a01809dcbfe493ca3a02579cc0f6a898 not found: ID does not exist"
Oct 30 10:57:49.763254 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.763232    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:49.777079 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.777061    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c5cf4bdf7-hxdrs"]
Oct 30 10:57:49.801941 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:49.801921    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" path="/var/lib/kubelet/pods/fde3fa89-d9a7-44b8-8564-d26b772c8b78/volumes"
Oct 30 10:57:55.973358 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:55.973317    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:57:55.973742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:55.973622    4488 cpu_manager.go:414] "containerMap: removing container" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerName="ta-container"
Oct 30 10:57:55.973742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:55.973633    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerName="ta-container"
Oct 30 10:57:55.973742 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:55.973692    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde3fa89-d9a7-44b8-8564-d26b772c8b78" containerName="ta-container"
Oct 30 10:57:55.976737 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:55.976721    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.009120 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.009097    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:57:56.037683 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.037659    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9wr\" (UniqueName: \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.037788 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.037726    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.037833 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.037798    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.138513 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.138484    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.138623 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.138517    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.138623 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.138543    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9wr\" (UniqueName: \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.139112 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.139092    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.140893 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.140872    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.206881 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.206854    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9wr\" (UniqueName: \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\") pod \"data-science-collector-targetallocator-6b945d76dc-bpfdl\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.287472 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.287422    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.582297 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.582274    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:57:56.584792 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:57:56.584759    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70456b1c_988c_4adc_b1d1_80eccf33d386.slice/crio-fb9440ee3334c1447584dd1e1b80284ba345717463fc4ccab04043c226231bd6 WatchSource:0}: Error finding container fb9440ee3334c1447584dd1e1b80284ba345717463fc4ccab04043c226231bd6: Status 404 returned error can't find the container with id fb9440ee3334c1447584dd1e1b80284ba345717463fc4ccab04043c226231bd6
Oct 30 10:57:56.586691 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.586656    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:56.586801 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.586717    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:57:56.745078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.745041    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" event={"ID":"70456b1c-988c-4adc-b1d1-80eccf33d386","Type":"ContainerStarted","Data":"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"}
Oct 30 10:57:56.745078 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.745081    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" event={"ID":"70456b1c-988c-4adc-b1d1-80eccf33d386","Type":"ContainerStarted","Data":"fb9440ee3334c1447584dd1e1b80284ba345717463fc4ccab04043c226231bd6"}
Oct 30 10:57:56.745317 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.745250    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:56.746204 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.746162    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.36:8080/readyz\": dial tcp 10.133.0.36:8080: connect: connection refused"
Oct 30 10:57:56.790665 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:56.790622    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" podStartSLOduration=1.790609093 podStartE2EDuration="1.790609093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:57:56.789646612 +0000 UTC m=+773.135238495" watchObservedRunningTime="2026-10-30 10:57:56.790609093 +0000 UTC m=+773.136200941"
Oct 30 10:57:57.749845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:57.749814    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:57:57.829511 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:57.829484    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:57.829706 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:57.829667    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" podUID="96eddfa8-c105-4b33-83b5-4832f1871983" containerName="ta-container" containerID="cri-o://2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe" gracePeriod=30
Oct 30 10:57:58.063407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.063384    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:58.155464 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.155436    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\") pod \"96eddfa8-c105-4b33-83b5-4832f1871983\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") "
Oct 30 10:57:58.155612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.155478    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\" (UniqueName: \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\") pod \"96eddfa8-c105-4b33-83b5-4832f1871983\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") "
Oct 30 10:57:58.155612 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.155581    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\" (UniqueName: \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\") pod \"96eddfa8-c105-4b33-83b5-4832f1871983\" (UID: \"96eddfa8-c105-4b33-83b5-4832f1871983\") "
Oct 30 10:57:58.155938 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.155911    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal" pod "96eddfa8-c105-4b33-83b5-4832f1871983" (UID: "96eddfa8-c105-4b33-83b5-4832f1871983"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:57:58.157418 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.157396    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert" pod "96eddfa8-c105-4b33-83b5-4832f1871983" (UID: "96eddfa8-c105-4b33-83b5-4832f1871983"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:57:58.157533 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.157513    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2" pod "96eddfa8-c105-4b33-83b5-4832f1871983" (UID: "96eddfa8-c105-4b33-83b5-4832f1871983"). InnerVolumeSpecName "kube-api-access-h8hm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:57:58.256713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.256684    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96eddfa8-c105-4b33-83b5-4832f1871983-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:58.256713 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.256710    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8hm2\" (UniqueName: \"kubernetes.io/projected/96eddfa8-c105-4b33-83b5-4832f1871983-kube-api-access-h8hm2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:58.256846 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.256722    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96eddfa8-c105-4b33-83b5-4832f1871983-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:57:58.754980 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.754948    4488 generic.go:356] "Generic (PLEG): container finished" podID="96eddfa8-c105-4b33-83b5-4832f1871983" containerID="2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe" exitCode=0
Oct 30 10:57:58.755458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.754992    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"
Oct 30 10:57:58.755458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.755032    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" event={"ID":"96eddfa8-c105-4b33-83b5-4832f1871983","Type":"ContainerDied","Data":"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"}
Oct 30 10:57:58.755458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.755079    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd" event={"ID":"96eddfa8-c105-4b33-83b5-4832f1871983","Type":"ContainerDied","Data":"6a732974900a76a6e02f83027398f1a9747868b239c8a0b4da26cfaa2cac5e58"}
Oct 30 10:57:58.755458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.755103    4488 scope.go:122] "RemoveContainer" containerID="2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"
Oct 30 10:57:58.763458 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.763440    4488 scope.go:122] "RemoveContainer" containerID="2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"
Oct 30 10:57:58.763706 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:57:58.763691    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe\": container with ID starting with 2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe not found: ID does not exist" containerID="2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"
Oct 30 10:57:58.763752 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.763714    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe"} err="failed to get container status \"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe\": rpc error: code = NotFound desc = could not find container \"2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe\": container with ID starting with 2525b3bab23362da0bcbe46b9db37cf3f5c6a539db613c015d24cb583794aebe not found: ID does not exist"
Oct 30 10:57:58.809650 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.809628    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:58.824039 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:58.824012    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55766888fb-8r7vd"]
Oct 30 10:57:59.801605 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:57:59.801574    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96eddfa8-c105-4b33-83b5-4832f1871983" path="/var/lib/kubelet/pods/96eddfa8-c105-4b33-83b5-4832f1871983/volumes"
Oct 30 10:58:01.477712 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:01.477680    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:58:04.035985 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.035958    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:04.036294 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.036258    4488 cpu_manager.go:414] "containerMap: removing container" podUID="96eddfa8-c105-4b33-83b5-4832f1871983" containerName="ta-container"
Oct 30 10:58:04.036294 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.036268    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96eddfa8-c105-4b33-83b5-4832f1871983" containerName="ta-container"
Oct 30 10:58:04.036394 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.036323    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="96eddfa8-c105-4b33-83b5-4832f1871983" containerName="ta-container"
Oct 30 10:58:04.040653 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.040635    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.074530 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.074502    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:04.100729 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.100706    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.100839 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.100732    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dc9x\" (UniqueName: \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.100839 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.100771    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.202048 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.202026    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.202170 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.202060    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dc9x\" (UniqueName: \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.202170 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.202129    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.202700 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.202679    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.204461 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.204440    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.226367 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.226334    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dc9x\" (UniqueName: \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\") pod \"data-science-collector-targetallocator-9bf84bfb6-rt8bz\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.351626 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.351602    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.645041 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.644952    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:04.647616 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:04.647587    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd34d3398_1d0b_436b_82af_ccb95cbbbb42.slice/crio-3a3415a817674c9009f6826ad4f14196a457f5a413be576b6d566f74d54d9134 WatchSource:0}: Error finding container 3a3415a817674c9009f6826ad4f14196a457f5a413be576b6d566f74d54d9134: Status 404 returned error can't find the container with id 3a3415a817674c9009f6826ad4f14196a457f5a413be576b6d566f74d54d9134
Oct 30 10:58:04.649880 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.649844    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:04.649964 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.649922    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:04.784709 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.784671    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" event={"ID":"d34d3398-1d0b-436b-82af-ccb95cbbbb42","Type":"ContainerStarted","Data":"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"}
Oct 30 10:58:04.784709 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.784708    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" event={"ID":"d34d3398-1d0b-436b-82af-ccb95cbbbb42","Type":"ContainerStarted","Data":"3a3415a817674c9009f6826ad4f14196a457f5a413be576b6d566f74d54d9134"}
Oct 30 10:58:04.784919 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.784902    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:04.785751 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.785723    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.37:8080/readyz\": dial tcp 10.133.0.37:8080: connect: connection refused"
Oct 30 10:58:04.828368 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:04.828313    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" podStartSLOduration=0.828301423 podStartE2EDuration="828.301423ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:04.827863868 +0000 UTC m=+781.173455722" watchObservedRunningTime="2026-10-30 10:58:04.828301423 +0000 UTC m=+781.173893277"
Oct 30 10:58:05.790857 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:05.790833    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:05.863728 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:05.863697    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:58:05.863887 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:05.863853    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerName="ta-container" containerID="cri-o://8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb" gracePeriod=30
Oct 30 10:58:06.100703 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.100679    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:58:06.119062 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.119038    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\") pod \"70456b1c-988c-4adc-b1d1-80eccf33d386\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") "
Oct 30 10:58:06.119203 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.119180    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\" (UniqueName: \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\") pod \"70456b1c-988c-4adc-b1d1-80eccf33d386\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") "
Oct 30 10:58:06.119276 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.119216    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\" (UniqueName: \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\") pod \"70456b1c-988c-4adc-b1d1-80eccf33d386\" (UID: \"70456b1c-988c-4adc-b1d1-80eccf33d386\") "
Oct 30 10:58:06.119639 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.119612    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal" pod "70456b1c-988c-4adc-b1d1-80eccf33d386" (UID: "70456b1c-988c-4adc-b1d1-80eccf33d386"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:06.121253 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.121230    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert" pod "70456b1c-988c-4adc-b1d1-80eccf33d386" (UID: "70456b1c-988c-4adc-b1d1-80eccf33d386"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:06.121685 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.121665    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr" pod "70456b1c-988c-4adc-b1d1-80eccf33d386" (UID: "70456b1c-988c-4adc-b1d1-80eccf33d386"). InnerVolumeSpecName "kube-api-access-6l9wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:06.220210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.220178    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/70456b1c-988c-4adc-b1d1-80eccf33d386-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:06.220210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.220205    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9wr\" (UniqueName: \"kubernetes.io/projected/70456b1c-988c-4adc-b1d1-80eccf33d386-kube-api-access-6l9wr\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:06.220210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.220215    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/70456b1c-988c-4adc-b1d1-80eccf33d386-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:06.794157 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.794125    4488 generic.go:356] "Generic (PLEG): container finished" podID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerID="8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb" exitCode=0
Oct 30 10:58:06.794561 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.794167    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"
Oct 30 10:58:06.794561 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.794206    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" event={"ID":"70456b1c-988c-4adc-b1d1-80eccf33d386","Type":"ContainerDied","Data":"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"}
Oct 30 10:58:06.794561 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.794243    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl" event={"ID":"70456b1c-988c-4adc-b1d1-80eccf33d386","Type":"ContainerDied","Data":"fb9440ee3334c1447584dd1e1b80284ba345717463fc4ccab04043c226231bd6"}
Oct 30 10:58:06.794561 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.794261    4488 scope.go:122] "RemoveContainer" containerID="8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"
Oct 30 10:58:06.808424 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.808405    4488 scope.go:122] "RemoveContainer" containerID="8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"
Oct 30 10:58:06.808719 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:06.808699    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb\": container with ID starting with 8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb not found: ID does not exist" containerID="8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"
Oct 30 10:58:06.808784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.808726    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb"} err="failed to get container status \"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb\": rpc error: code = NotFound desc = could not find container \"8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb\": container with ID starting with 8fa4c824fb439af5c555817e14fbd128578666549b3bf3bd3644698f5c96eedb not found: ID does not exist"
Oct 30 10:58:06.853001 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.852977    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:58:06.866213 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:06.866193    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b945d76dc-bpfdl"]
Oct 30 10:58:07.802517 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:07.802487    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" path="/var/lib/kubelet/pods/70456b1c-988c-4adc-b1d1-80eccf33d386/volumes"
Oct 30 10:58:11.699821 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.699792    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:11.700453 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.700250    4488 cpu_manager.go:414] "containerMap: removing container" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerName="ta-container"
Oct 30 10:58:11.700453 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.700268    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerName="ta-container"
Oct 30 10:58:11.700453 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.700388    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="70456b1c-988c-4adc-b1d1-80eccf33d386" containerName="ta-container"
Oct 30 10:58:11.703599 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.703577    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.722750 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.722728    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:11.735435 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.735413    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8vrjb\""
Oct 30 10:58:11.738483 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.738464    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 10:58:11.749296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.749270    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 10:58:11.749407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.749352    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 10:58:11.749407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.749374    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 10:58:11.761744 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.761717    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.761839 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.761769    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.761883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.761850    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.761883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.761868    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4c4\" (UniqueName: \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.761950 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.761905    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.862427 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.862403    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.862541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.862450    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.862607 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.862591    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.862663 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.862622    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4c4\" (UniqueName: \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.862762 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.862741    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.863488 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.863462    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.865084 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.865058    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.865180 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.865162    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.865296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.865276    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.873825 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.873805    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:11.877156 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.877142    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:11.887324 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.887302    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4c4\" (UniqueName: \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\") pod \"data-science-collector-collector-2\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:11.896898 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.896877    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:11.963264 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.963199    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhsw\" (UniqueName: \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:11.963264 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.963249    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:11.963445 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:11.963331    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.015925 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.015902    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:12.066029 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.064115    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhsw\" (UniqueName: \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.066029 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.064161    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.066029 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.064217    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.066029 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.064909    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.068011 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.067984    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.088690 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.088667    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhsw\" (UniqueName: \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\") pod \"data-science-collector-targetallocator-d86595749-r8k26\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.189080 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.189055    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.324440 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.324411    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:12.327266 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:12.327237    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d290cc2_c583_4c88_b19e_62c681aa673e.slice/crio-5743fa49eb241088577ddc0ea126814159ac48ce139fbe9f1792c3af4c93545b WatchSource:0}: Error finding container 5743fa49eb241088577ddc0ea126814159ac48ce139fbe9f1792c3af4c93545b: Status 404 returned error can't find the container with id 5743fa49eb241088577ddc0ea126814159ac48ce139fbe9f1792c3af4c93545b
Oct 30 10:58:12.486318 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.486295    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:12.488959 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:12.488935    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1c1efb_b5ef_4a30_8d8e_64563ef79bbd.slice/crio-525a5897c40bc76d543b011d9315a9ec6e6aa99e353ca9a2a08e34ccee2b3685 WatchSource:0}: Error finding container 525a5897c40bc76d543b011d9315a9ec6e6aa99e353ca9a2a08e34ccee2b3685: Status 404 returned error can't find the container with id 525a5897c40bc76d543b011d9315a9ec6e6aa99e353ca9a2a08e34ccee2b3685
Oct 30 10:58:12.490925 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.490891    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:12.491005 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.490945    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:12.820039 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.819957    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" event={"ID":"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd","Type":"ContainerStarted","Data":"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"}
Oct 30 10:58:12.820039 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.819995    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" event={"ID":"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd","Type":"ContainerStarted","Data":"525a5897c40bc76d543b011d9315a9ec6e6aa99e353ca9a2a08e34ccee2b3685"}
Oct 30 10:58:12.820595 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.820131    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:12.821541 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.821517    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"1d290cc2-c583-4c88-b19e-62c681aa673e","Type":"ContainerStarted","Data":"5743fa49eb241088577ddc0ea126814159ac48ce139fbe9f1792c3af4c93545b"}
Oct 30 10:58:12.821649 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.821538    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.39:8080/readyz\": dial tcp 10.133.0.39:8080: connect: connection refused"
Oct 30 10:58:12.864066 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:12.864022    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" podStartSLOduration=1.864011004 podStartE2EDuration="1.864011004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:12.863596908 +0000 UTC m=+789.209188762" watchObservedRunningTime="2026-10-30 10:58:12.864011004 +0000 UTC m=+789.209602851"
Oct 30 10:58:13.825978 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:13.825947    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:13.900377 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:13.900325    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:13.900555 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:13.900522    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerName="ta-container" containerID="cri-o://99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4" gracePeriod=30
Oct 30 10:58:14.162545 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.162515    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:14.279888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.279859    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\") pod \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") "
Oct 30 10:58:14.280022 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.279942    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\") pod \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") "
Oct 30 10:58:14.280022 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.279989    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\" (UniqueName: \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\") pod \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\" (UID: \"d34d3398-1d0b-436b-82af-ccb95cbbbb42\") "
Oct 30 10:58:14.280261 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.280241    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal" pod "d34d3398-1d0b-436b-82af-ccb95cbbbb42" (UID: "d34d3398-1d0b-436b-82af-ccb95cbbbb42"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:14.282159 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.282129    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x" pod "d34d3398-1d0b-436b-82af-ccb95cbbbb42" (UID: "d34d3398-1d0b-436b-82af-ccb95cbbbb42"). InnerVolumeSpecName "kube-api-access-8dc9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:14.282285 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.282259    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert" pod "d34d3398-1d0b-436b-82af-ccb95cbbbb42" (UID: "d34d3398-1d0b-436b-82af-ccb95cbbbb42"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:14.381034 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.380968    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d34d3398-1d0b-436b-82af-ccb95cbbbb42-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:14.381034 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.380995    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d34d3398-1d0b-436b-82af-ccb95cbbbb42-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:14.381034 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.381007    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dc9x\" (UniqueName: \"kubernetes.io/projected/d34d3398-1d0b-436b-82af-ccb95cbbbb42-kube-api-access-8dc9x\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:14.830762 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.830724    4488 generic.go:356] "Generic (PLEG): container finished" podID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerID="99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4" exitCode=0
Oct 30 10:58:14.831235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.830782    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"
Oct 30 10:58:14.831235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.830795    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" event={"ID":"d34d3398-1d0b-436b-82af-ccb95cbbbb42","Type":"ContainerDied","Data":"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"}
Oct 30 10:58:14.831235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.830841    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz" event={"ID":"d34d3398-1d0b-436b-82af-ccb95cbbbb42","Type":"ContainerDied","Data":"3a3415a817674c9009f6826ad4f14196a457f5a413be576b6d566f74d54d9134"}
Oct 30 10:58:14.831235 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.830866    4488 scope.go:122] "RemoveContainer" containerID="99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"
Oct 30 10:58:14.839504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.839485    4488 scope.go:122] "RemoveContainer" containerID="99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"
Oct 30 10:58:14.839804 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:14.839779    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4\": container with ID starting with 99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4 not found: ID does not exist" containerID="99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"
Oct 30 10:58:14.839923 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.839900    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4"} err="failed to get container status \"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4\": rpc error: code = NotFound desc = could not find container \"99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4\": container with ID starting with 99b845c34ed4ab6bcc13ff78b58eb949597ee0fcd0dd18da1294581ea720b5c4 not found: ID does not exist"
Oct 30 10:58:14.885498 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.885476    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:14.899482 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:14.899458    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9bf84bfb6-rt8bz"]
Oct 30 10:58:15.804336 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:15.804300    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" path="/var/lib/kubelet/pods/d34d3398-1d0b-436b-82af-ccb95cbbbb42/volumes"
Oct 30 10:58:16.608961 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:16.608931    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:16.609217 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:16.608990    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:16.841473 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:16.841440    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"1d290cc2-c583-4c88-b19e-62c681aa673e","Type":"ContainerStarted","Data":"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"}
Oct 30 10:58:16.894728 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:16.893543    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-2" podStartSLOduration=1.6145931340000002 podStartE2EDuration="5.893524709s" totalImagesPullingTime="4.278931575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:16.891133328 +0000 UTC m=+793.236725184" watchObservedRunningTime="2026-10-30 10:58:16.893524709 +0000 UTC m=+793.239116563"
Oct 30 10:58:19.569159 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.569126    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:19.569590 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.569311    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-2" podUID="1d290cc2-c583-4c88-b19e-62c681aa673e" containerName="otc-container" containerID="cri-o://f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af" gracePeriod=30
Oct 30 10:58:19.778829 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.778802    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:19.779146 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.779133    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerName="ta-container"
Oct 30 10:58:19.779190 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.779148    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerName="ta-container"
Oct 30 10:58:19.779238 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.779228    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d34d3398-1d0b-436b-82af-ccb95cbbbb42" containerName="ta-container"
Oct 30 10:58:19.782228 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.782208    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.804336 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.804308    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:19.815682 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.815664    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:19.821783 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.821736    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.821872 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.821786    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwhg\" (UniqueName: \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.821916 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.821875    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.854317 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.854291    4488 generic.go:356] "Generic (PLEG): container finished" podID="1d290cc2-c583-4c88-b19e-62c681aa673e" containerID="f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af" exitCode=0
Oct 30 10:58:19.854447 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.854330    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 10:58:19.854447 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.854377    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"1d290cc2-c583-4c88-b19e-62c681aa673e","Type":"ContainerDied","Data":"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"}
Oct 30 10:58:19.854447 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.854428    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"1d290cc2-c583-4c88-b19e-62c681aa673e","Type":"ContainerDied","Data":"5743fa49eb241088577ddc0ea126814159ac48ce139fbe9f1792c3af4c93545b"}
Oct 30 10:58:19.854562 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.854450    4488 scope.go:122] "RemoveContainer" containerID="f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"
Oct 30 10:58:19.862101 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.862082    4488 scope.go:122] "RemoveContainer" containerID="f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"
Oct 30 10:58:19.862378 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:19.862358    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af\": container with ID starting with f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af not found: ID does not exist" containerID="f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"
Oct 30 10:58:19.862497 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.862390    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af"} err="failed to get container status \"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af\": rpc error: code = NotFound desc = could not find container \"f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af\": container with ID starting with f2e2d548ce44e433212e21854cabd0c26aa1473d7b1b39c577b0b9ac396751af not found: ID does not exist"
Oct 30 10:58:19.922816 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922790    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\") pod \"1d290cc2-c583-4c88-b19e-62c681aa673e\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") "
Oct 30 10:58:19.922971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922829    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\") pod \"1d290cc2-c583-4c88-b19e-62c681aa673e\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") "
Oct 30 10:58:19.922971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922854    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\") pod \"1d290cc2-c583-4c88-b19e-62c681aa673e\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") "
Oct 30 10:58:19.922971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922876    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\" (UniqueName: \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\") pod \"1d290cc2-c583-4c88-b19e-62c681aa673e\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") "
Oct 30 10:58:19.922971 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922918    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\" (UniqueName: \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\") pod \"1d290cc2-c583-4c88-b19e-62c681aa673e\" (UID: \"1d290cc2-c583-4c88-b19e-62c681aa673e\") "
Oct 30 10:58:19.923210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.922996    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.923210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.923036    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.923210 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.923087    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwhg\" (UniqueName: \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.923446 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.923419    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal" pod "1d290cc2-c583-4c88-b19e-62c681aa673e" (UID: "1d290cc2-c583-4c88-b19e-62c681aa673e"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:19.924062 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.924034    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.925107 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.925081    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert" pod "1d290cc2-c583-4c88-b19e-62c681aa673e" (UID: "1d290cc2-c583-4c88-b19e-62c681aa673e"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:19.925299 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.925271    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs" pod "1d290cc2-c583-4c88-b19e-62c681aa673e" (UID: "1d290cc2-c583-4c88-b19e-62c681aa673e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:19.925407 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.925316    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs" pod "1d290cc2-c583-4c88-b19e-62c681aa673e" (UID: "1d290cc2-c583-4c88-b19e-62c681aa673e"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:19.925525 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.925507    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4" pod "1d290cc2-c583-4c88-b19e-62c681aa673e" (UID: "1d290cc2-c583-4c88-b19e-62c681aa673e"). InnerVolumeSpecName "kube-api-access-8p4c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:19.925792 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.925775    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:19.948873 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:19.948850    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwhg\" (UniqueName: \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\") pod \"data-science-collector-targetallocator-7d988cdcfb-pz5tw\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:20.024436 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.024408    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:20.024436 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.024432    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:20.024436 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.024441    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p4c4\" (UniqueName: \"kubernetes.io/projected/1d290cc2-c583-4c88-b19e-62c681aa673e-kube-api-access-8p4c4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:20.024617 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.024450    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1d290cc2-c583-4c88-b19e-62c681aa673e-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:20.024617 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.024459    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d290cc2-c583-4c88-b19e-62c681aa673e-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:20.093922 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.093863    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:20.203147 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.203116    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:20.217114 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.217090    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 10:58:20.386648 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.386547    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:20.389050 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:20.389024    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1511471_6f8e_417a_9246_5c5fa8da9f81.slice/crio-f669b069022f2509f659ed59d3751ba97832a2b64f4c9941011312608c1c61ea WatchSource:0}: Error finding container f669b069022f2509f659ed59d3751ba97832a2b64f4c9941011312608c1c61ea: Status 404 returned error can't find the container with id f669b069022f2509f659ed59d3751ba97832a2b64f4c9941011312608c1c61ea
Oct 30 10:58:20.391166 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.391139    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:20.391229 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.391187    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:20.861024 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.860984    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" event={"ID":"a1511471-6f8e-417a-9246-5c5fa8da9f81","Type":"ContainerStarted","Data":"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"}
Oct 30 10:58:20.861533 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.861037    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" event={"ID":"a1511471-6f8e-417a-9246-5c5fa8da9f81","Type":"ContainerStarted","Data":"f669b069022f2509f659ed59d3751ba97832a2b64f4c9941011312608c1c61ea"}
Oct 30 10:58:20.861533 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.861060    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:20.863145 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.863124    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:20.904752 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.904711    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" podStartSLOduration=1.904697392 podStartE2EDuration="1.904697392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:20.904497264 +0000 UTC m=+797.250089129" watchObservedRunningTime="2026-10-30 10:58:20.904697392 +0000 UTC m=+797.250289247"
Oct 30 10:58:20.977420 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.977396    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:20.977569 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:20.977550    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerName="ta-container" containerID="cri-o://ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb" gracePeriod=30
Oct 30 10:58:21.211307 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.211277    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:21.333562 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.333533    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\") pod \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") "
Oct 30 10:58:21.333717 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.333581    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\" (UniqueName: \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\") pod \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") "
Oct 30 10:58:21.333717 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.333601    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\") pod \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\" (UID: \"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd\") "
Oct 30 10:58:21.333950 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.333929    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal" pod "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" (UID: "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:21.335553 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.335530    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw" pod "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" (UID: "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd"). InnerVolumeSpecName "kube-api-access-lqhsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:21.335632 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.335613    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert" pod "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" (UID: "2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:21.434671 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.434637    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:21.434671 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.434670    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqhsw\" (UniqueName: \"kubernetes.io/projected/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-kube-api-access-lqhsw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:21.434842 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.434686    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:21.805108 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.805040    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d290cc2-c583-4c88-b19e-62c681aa673e" path="/var/lib/kubelet/pods/1d290cc2-c583-4c88-b19e-62c681aa673e/volumes"
Oct 30 10:58:21.866604 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.866571    4488 generic.go:356] "Generic (PLEG): container finished" podID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerID="ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb" exitCode=0
Oct 30 10:58:21.866929 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.866620    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"
Oct 30 10:58:21.866929 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.866652    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" event={"ID":"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd","Type":"ContainerDied","Data":"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"}
Oct 30 10:58:21.866929 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.866696    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26" event={"ID":"2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd","Type":"ContainerDied","Data":"525a5897c40bc76d543b011d9315a9ec6e6aa99e353ca9a2a08e34ccee2b3685"}
Oct 30 10:58:21.866929 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.866714    4488 scope.go:122] "RemoveContainer" containerID="ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"
Oct 30 10:58:21.874593 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.874580    4488 scope.go:122] "RemoveContainer" containerID="ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"
Oct 30 10:58:21.874890 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:21.874873    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb\": container with ID starting with ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb not found: ID does not exist" containerID="ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"
Oct 30 10:58:21.874937 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.874898    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb"} err="failed to get container status \"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb\": rpc error: code = NotFound desc = could not find container \"ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb\": container with ID starting with ea097d49b6cc7cc1ab96bc706ced9ae7767a279d5bfdaa158884ba1aeec2e0bb not found: ID does not exist"
Oct 30 10:58:21.921080 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.921060    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:21.934978 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:21.934954    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d86595749-r8k26"]
Oct 30 10:58:23.802999 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:23.802959    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" path="/var/lib/kubelet/pods/2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd/volumes"
Oct 30 10:58:31.034468 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034434    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034769    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1d290cc2-c583-4c88-b19e-62c681aa673e" containerName="otc-container"
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034782    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d290cc2-c583-4c88-b19e-62c681aa673e" containerName="otc-container"
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034797    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerName="ta-container"
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034802    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerName="ta-container"
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034853    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d290cc2-c583-4c88-b19e-62c681aa673e" containerName="otc-container"
Oct 30 10:58:31.034878 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.034863    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c1c1efb-b5ef-4a30-8d8e-64563ef79bbd" containerName="ta-container"
Oct 30 10:58:31.038997 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.038979    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.057790 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.057765    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:31.109451 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.109425    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.109572 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.109464    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.109572 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.109490    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84kj9\" (UniqueName: \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.210336 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.210307    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.210450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.210375    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.210450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.210416    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84kj9\" (UniqueName: \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.210985 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.210968    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.212632 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.212616    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.235004 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.234976    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84kj9\" (UniqueName: \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\") pod \"data-science-collector-targetallocator-8575fd789f-424dp\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.349590 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.349541    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.477943 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:31.477900    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:58:31.645004 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.644983    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:31.647430 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:31.647405    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d87f69b_24a3_4226_8af0_3db409af4120.slice/crio-63bbe031ed0bedf054fef0fdf2e743dbdde5da30ee18b83ec1b34cc6d2f70459 WatchSource:0}: Error finding container 63bbe031ed0bedf054fef0fdf2e743dbdde5da30ee18b83ec1b34cc6d2f70459: Status 404 returned error can't find the container with id 63bbe031ed0bedf054fef0fdf2e743dbdde5da30ee18b83ec1b34cc6d2f70459
Oct 30 10:58:31.649588 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.649555    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:31.649683 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.649611    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:31.908845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.908763    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" event={"ID":"9d87f69b-24a3-4226-8af0-3db409af4120","Type":"ContainerStarted","Data":"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"}
Oct 30 10:58:31.908845 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.908803    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" event={"ID":"9d87f69b-24a3-4226-8af0-3db409af4120","Type":"ContainerStarted","Data":"63bbe031ed0bedf054fef0fdf2e743dbdde5da30ee18b83ec1b34cc6d2f70459"}
Oct 30 10:58:31.909043 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.908933    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:31.910117 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.910092    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.41:8080/readyz\": dial tcp 10.133.0.41:8080: connect: connection refused"
Oct 30 10:58:31.953455 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:31.953410    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" podStartSLOduration=0.953396641 podStartE2EDuration="953.396641ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:31.952238093 +0000 UTC m=+808.297829947" watchObservedRunningTime="2026-10-30 10:58:31.953396641 +0000 UTC m=+808.298988494"
Oct 30 10:58:32.913838 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:32.913809    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:32.987119 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:32.987088    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:32.987270 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:32.987248    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" podUID="a1511471-6f8e-417a-9246-5c5fa8da9f81" containerName="ta-container" containerID="cri-o://3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6" gracePeriod=30
Oct 30 10:58:33.232663 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.232643    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:33.326987 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.326964    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\" (UniqueName: \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\") pod \"a1511471-6f8e-417a-9246-5c5fa8da9f81\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") "
Oct 30 10:58:33.327092 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.326995    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\") pod \"a1511471-6f8e-417a-9246-5c5fa8da9f81\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") "
Oct 30 10:58:33.327161 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.327138    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\") pod \"a1511471-6f8e-417a-9246-5c5fa8da9f81\" (UID: \"a1511471-6f8e-417a-9246-5c5fa8da9f81\") "
Oct 30 10:58:33.327504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.327482    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal" pod "a1511471-6f8e-417a-9246-5c5fa8da9f81" (UID: "a1511471-6f8e-417a-9246-5c5fa8da9f81"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:33.328948 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.328925    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert" pod "a1511471-6f8e-417a-9246-5c5fa8da9f81" (UID: "a1511471-6f8e-417a-9246-5c5fa8da9f81"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:33.329012 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.328954    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg" pod "a1511471-6f8e-417a-9246-5c5fa8da9f81" (UID: "a1511471-6f8e-417a-9246-5c5fa8da9f81"). InnerVolumeSpecName "kube-api-access-zvwhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:33.428032 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.428011    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a1511471-6f8e-417a-9246-5c5fa8da9f81-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:33.428032 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.428033    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvwhg\" (UniqueName: \"kubernetes.io/projected/a1511471-6f8e-417a-9246-5c5fa8da9f81-kube-api-access-zvwhg\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:33.428158 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.428044    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a1511471-6f8e-417a-9246-5c5fa8da9f81-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:33.917404 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.917375    4488 generic.go:356] "Generic (PLEG): container finished" podID="a1511471-6f8e-417a-9246-5c5fa8da9f81" containerID="3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6" exitCode=0
Oct 30 10:58:33.917755 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.917441    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" event={"ID":"a1511471-6f8e-417a-9246-5c5fa8da9f81","Type":"ContainerDied","Data":"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"}
Oct 30 10:58:33.917755 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.917458    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"
Oct 30 10:58:33.917755 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.917489    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw" event={"ID":"a1511471-6f8e-417a-9246-5c5fa8da9f81","Type":"ContainerDied","Data":"f669b069022f2509f659ed59d3751ba97832a2b64f4c9941011312608c1c61ea"}
Oct 30 10:58:33.917755 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.917506    4488 scope.go:122] "RemoveContainer" containerID="3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"
Oct 30 10:58:33.925230 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.925212    4488 scope.go:122] "RemoveContainer" containerID="3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"
Oct 30 10:58:33.925495 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:33.925478    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6\": container with ID starting with 3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6 not found: ID does not exist" containerID="3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"
Oct 30 10:58:33.925570 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.925503    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6"} err="failed to get container status \"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6\": rpc error: code = NotFound desc = could not find container \"3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6\": container with ID starting with 3bbeedaec021238be3689b7e83d0c1e6708752d0eee6dab3755db404e50399f6 not found: ID does not exist"
Oct 30 10:58:33.972309 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.972283    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:33.986202 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:33.986174    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d988cdcfb-pz5tw"]
Oct 30 10:58:35.803898 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:35.803867    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1511471-6f8e-417a-9246-5c5fa8da9f81" path="/var/lib/kubelet/pods/a1511471-6f8e-417a-9246-5c5fa8da9f81/volumes"
Oct 30 10:58:37.502869 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.502834    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:58:37.503250 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.503120    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a1511471-6f8e-417a-9246-5c5fa8da9f81" containerName="ta-container"
Oct 30 10:58:37.503250 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.503130    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1511471-6f8e-417a-9246-5c5fa8da9f81" containerName="ta-container"
Oct 30 10:58:37.503250 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.503181    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1511471-6f8e-417a-9246-5c5fa8da9f81" containerName="ta-container"
Oct 30 10:58:37.507284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.507267    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.542445 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.542414    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:58:37.662104 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.662074    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nn5\" (UniqueName: \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.662244 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.662112    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.662244 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.662226    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.763153 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.763087    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.763153 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.763129    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nn5\" (UniqueName: \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.763153 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.763152    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.763715 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.763696    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.765484 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.765465    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.787768 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.787739    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nn5\" (UniqueName: \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\") pod \"data-science-collector-targetallocator-54cc77846f-5kbgt\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:37.818552 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:37.818531    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:38.113214 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.113189    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:58:38.115654 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:58:38.115630    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f349243_d1dd_4f4a_88f8_efac35a87f42.slice/crio-7a0e95907b83b908a56c33b7a4cae44437de7d17d9e1a9fdeff902b02f1a9db1 WatchSource:0}: Error finding container 7a0e95907b83b908a56c33b7a4cae44437de7d17d9e1a9fdeff902b02f1a9db1: Status 404 returned error can't find the container with id 7a0e95907b83b908a56c33b7a4cae44437de7d17d9e1a9fdeff902b02f1a9db1
Oct 30 10:58:38.117699 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.117668    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:38.117784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.117719    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:58:38.939510 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.939474    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" event={"ID":"9f349243-d1dd-4f4a-88f8-efac35a87f42","Type":"ContainerStarted","Data":"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"}
Oct 30 10:58:38.939510 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.939516    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" event={"ID":"9f349243-d1dd-4f4a-88f8-efac35a87f42","Type":"ContainerStarted","Data":"7a0e95907b83b908a56c33b7a4cae44437de7d17d9e1a9fdeff902b02f1a9db1"}
Oct 30 10:58:38.939958 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.939629    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:38.941239 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.941218    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:58:38.984754 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:38.984715    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" podStartSLOduration=1.984703841 podStartE2EDuration="1.984703841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:58:38.983443039 +0000 UTC m=+815.329034893" watchObservedRunningTime="2026-10-30 10:58:38.984703841 +0000 UTC m=+815.330295694"
Oct 30 10:58:39.057670 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.057641    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:39.057811 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.057788    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" containerName="ta-container" containerID="cri-o://934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708" gracePeriod=30
Oct 30 10:58:39.291591 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.291572    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:39.376499 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.376474    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\") pod \"9d87f69b-24a3-4226-8af0-3db409af4120\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") "
Oct 30 10:58:39.376625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.376533    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\") pod \"9d87f69b-24a3-4226-8af0-3db409af4120\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") "
Oct 30 10:58:39.376625 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.376580    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\" (UniqueName: \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\") pod \"9d87f69b-24a3-4226-8af0-3db409af4120\" (UID: \"9d87f69b-24a3-4226-8af0-3db409af4120\") "
Oct 30 10:58:39.376854 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.376832    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal" pod "9d87f69b-24a3-4226-8af0-3db409af4120" (UID: "9d87f69b-24a3-4226-8af0-3db409af4120"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:58:39.378508 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.378490    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9" pod "9d87f69b-24a3-4226-8af0-3db409af4120" (UID: "9d87f69b-24a3-4226-8af0-3db409af4120"). InnerVolumeSpecName "kube-api-access-84kj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:58:39.378614 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.378596    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert" pod "9d87f69b-24a3-4226-8af0-3db409af4120" (UID: "9d87f69b-24a3-4226-8af0-3db409af4120"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:58:39.477647 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.477592    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9d87f69b-24a3-4226-8af0-3db409af4120-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:39.477647 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.477620    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84kj9\" (UniqueName: \"kubernetes.io/projected/9d87f69b-24a3-4226-8af0-3db409af4120-kube-api-access-84kj9\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:39.477647 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.477629    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9d87f69b-24a3-4226-8af0-3db409af4120-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:58:39.943970 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.943940    4488 generic.go:356] "Generic (PLEG): container finished" podID="9d87f69b-24a3-4226-8af0-3db409af4120" containerID="934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708" exitCode=0
Oct 30 10:58:39.944330 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.943980    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"
Oct 30 10:58:39.944330 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.944019    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" event={"ID":"9d87f69b-24a3-4226-8af0-3db409af4120","Type":"ContainerDied","Data":"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"}
Oct 30 10:58:39.944330 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.944053    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp" event={"ID":"9d87f69b-24a3-4226-8af0-3db409af4120","Type":"ContainerDied","Data":"63bbe031ed0bedf054fef0fdf2e743dbdde5da30ee18b83ec1b34cc6d2f70459"}
Oct 30 10:58:39.944330 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.944084    4488 scope.go:122] "RemoveContainer" containerID="934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"
Oct 30 10:58:39.952583 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.952564    4488 scope.go:122] "RemoveContainer" containerID="934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"
Oct 30 10:58:39.952864 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:58:39.952841    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708\": container with ID starting with 934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708 not found: ID does not exist" containerID="934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"
Oct 30 10:58:39.952939 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.952874    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708"} err="failed to get container status \"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708\": rpc error: code = NotFound desc = could not find container \"934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708\": container with ID starting with 934cab54fd5864f0dc57e0d9abe33e707b7aea02cabccde8039d47f2ee899708 not found: ID does not exist"
Oct 30 10:58:39.998970 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:39.998949    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:40.012644 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:40.012622    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-424dp"]
Oct 30 10:58:41.801974 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:58:41.801942    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" path="/var/lib/kubelet/pods/9d87f69b-24a3-4226-8af0-3db409af4120/volumes"
Oct 30 10:59:01.477327 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:59:01.477288    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:59:31.478552 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:59:31.478446    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 10:59:42.556065 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.556030    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:42.556450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.556306    4488 cpu_manager.go:414] "containerMap: removing container" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" containerName="ta-container"
Oct 30 10:59:42.556450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.556317    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" containerName="ta-container"
Oct 30 10:59:42.556450 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.556417    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d87f69b-24a3-4226-8af0-3db409af4120" containerName="ta-container"
Oct 30 10:59:42.559348 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.559324    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.591842 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.591819    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:42.632989 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.632963    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.633099 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.632996    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.633099 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.633020    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fcg\" (UniqueName: \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.733488 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.733462    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.733610 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.733493    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.733610 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.733523    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fcg\" (UniqueName: \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.734021 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.734000    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.735893 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.735872    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.758481 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.758464    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fcg\" (UniqueName: \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\") pod \"data-science-collector-targetallocator-85c58c4998-hhjxq\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:42.871116 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:42.871069    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:43.166548 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:43.166471    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:43.169309 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:59:43.169282    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacf70085_d565_429c_bb27_596708f1cee4.slice/crio-2fb867245e539d0e2416a1422d97c812c60d2eebc4278cc7fa48f6fe58289d34 WatchSource:0}: Error finding container 2fb867245e539d0e2416a1422d97c812c60d2eebc4278cc7fa48f6fe58289d34: Status 404 returned error can't find the container with id 2fb867245e539d0e2416a1422d97c812c60d2eebc4278cc7fa48f6fe58289d34
Oct 30 10:59:43.171569 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:43.171530    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:43.171639 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:43.171602    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:43.188701 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:43.188677    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" event={"ID":"acf70085-d565-429c-bb27-596708f1cee4","Type":"ContainerStarted","Data":"2fb867245e539d0e2416a1422d97c812c60d2eebc4278cc7fa48f6fe58289d34"}
Oct 30 10:59:44.193422 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.193389    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" event={"ID":"acf70085-d565-429c-bb27-596708f1cee4","Type":"ContainerStarted","Data":"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"}
Oct 30 10:59:44.193808 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.193505    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:44.195173 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.195153    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:44.237996 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.237956    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" podStartSLOduration=2.237942151 podStartE2EDuration="2.237942151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:59:44.237309625 +0000 UTC m=+880.582901491" watchObservedRunningTime="2026-10-30 10:59:44.237942151 +0000 UTC m=+880.583534005"
Oct 30 10:59:44.311615 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.311577    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:59:44.311785 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.311760    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" podUID="9f349243-d1dd-4f4a-88f8-efac35a87f42" containerName="ta-container" containerID="cri-o://c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9" gracePeriod=30
Oct 30 10:59:44.545187 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.545158    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:59:44.649784 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.649755    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\") pod \"9f349243-d1dd-4f4a-88f8-efac35a87f42\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") "
Oct 30 10:59:44.649928 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.649794    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\" (UniqueName: \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\") pod \"9f349243-d1dd-4f4a-88f8-efac35a87f42\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") "
Oct 30 10:59:44.649928 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.649852    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\") pod \"9f349243-d1dd-4f4a-88f8-efac35a87f42\" (UID: \"9f349243-d1dd-4f4a-88f8-efac35a87f42\") "
Oct 30 10:59:44.650296 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.650271    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal" pod "9f349243-d1dd-4f4a-88f8-efac35a87f42" (UID: "9f349243-d1dd-4f4a-88f8-efac35a87f42"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:59:44.651776 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.651751    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert" pod "9f349243-d1dd-4f4a-88f8-efac35a87f42" (UID: "9f349243-d1dd-4f4a-88f8-efac35a87f42"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:59:44.651854 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.651809    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5" pod "9f349243-d1dd-4f4a-88f8-efac35a87f42" (UID: "9f349243-d1dd-4f4a-88f8-efac35a87f42"). InnerVolumeSpecName "kube-api-access-z7nn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:59:44.751284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.751224    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f349243-d1dd-4f4a-88f8-efac35a87f42-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:44.751284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.751252    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7nn5\" (UniqueName: \"kubernetes.io/projected/9f349243-d1dd-4f4a-88f8-efac35a87f42-kube-api-access-z7nn5\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:44.751284 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:44.751267    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f349243-d1dd-4f4a-88f8-efac35a87f42-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:45.198681 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.198653    4488 generic.go:356] "Generic (PLEG): container finished" podID="9f349243-d1dd-4f4a-88f8-efac35a87f42" containerID="c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9" exitCode=0
Oct 30 10:59:45.199060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.198692    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"
Oct 30 10:59:45.199060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.198735    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" event={"ID":"9f349243-d1dd-4f4a-88f8-efac35a87f42","Type":"ContainerDied","Data":"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"}
Oct 30 10:59:45.199060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.198773    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt" event={"ID":"9f349243-d1dd-4f4a-88f8-efac35a87f42","Type":"ContainerDied","Data":"7a0e95907b83b908a56c33b7a4cae44437de7d17d9e1a9fdeff902b02f1a9db1"}
Oct 30 10:59:45.199060 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.198793    4488 scope.go:122] "RemoveContainer" containerID="c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"
Oct 30 10:59:45.207240 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.207223    4488 scope.go:122] "RemoveContainer" containerID="c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"
Oct 30 10:59:45.207552 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:59:45.207535    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9\": container with ID starting with c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9 not found: ID does not exist" containerID="c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"
Oct 30 10:59:45.207596 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.207560    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9"} err="failed to get container status \"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9\": rpc error: code = NotFound desc = could not find container \"c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9\": container with ID starting with c187afebe7f4286c77e5c82a4e4c5078eea04da9fc3937e149e17efff574bdf9 not found: ID does not exist"
Oct 30 10:59:45.254898 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.254759    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:59:45.267997 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.267977    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54cc77846f-5kbgt"]
Oct 30 10:59:45.802765 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:45.802735    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f349243-d1dd-4f4a-88f8-efac35a87f42" path="/var/lib/kubelet/pods/9f349243-d1dd-4f4a-88f8-efac35a87f42/volumes"
Oct 30 10:59:50.231385 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.231354    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:50.231751 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.231639    4488 cpu_manager.go:414] "containerMap: removing container" podUID="9f349243-d1dd-4f4a-88f8-efac35a87f42" containerName="ta-container"
Oct 30 10:59:50.231751 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.231650    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f349243-d1dd-4f4a-88f8-efac35a87f42" containerName="ta-container"
Oct 30 10:59:50.231751 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.231712    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f349243-d1dd-4f4a-88f8-efac35a87f42" containerName="ta-container"
Oct 30 10:59:50.235669 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.235652    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.254035 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.254012    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:50.292333 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.292307    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nsv\" (UniqueName: \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.292443 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.292358    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.292484 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.292453    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.393517 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.393490    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.393608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.393549    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nsv\" (UniqueName: \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.393608 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.393582    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.394103 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.394086    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.395879 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.395862    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.418359 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.418323    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nsv\" (UniqueName: \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\") pod \"data-science-collector-targetallocator-8575fd789f-zq69j\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.546504 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.546447    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:50.840883 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.840860    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:50.843487 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:59:50.843462    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9d8f2fd_7edd_4e46_ad82_9d51cf711ab7.slice/crio-caaf79dd0a2be1c9598d03d1dcccb52f93b444c6c1d5c6777d212b4bdb1ae113 WatchSource:0}: Error finding container caaf79dd0a2be1c9598d03d1dcccb52f93b444c6c1d5c6777d212b4bdb1ae113: Status 404 returned error can't find the container with id caaf79dd0a2be1c9598d03d1dcccb52f93b444c6c1d5c6777d212b4bdb1ae113
Oct 30 10:59:50.845537 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.845507    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:50.845632 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:50.845558    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:51.225942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:51.225907    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" event={"ID":"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7","Type":"ContainerStarted","Data":"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"}
Oct 30 10:59:51.225942 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:51.225946    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" event={"ID":"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7","Type":"ContainerStarted","Data":"caaf79dd0a2be1c9598d03d1dcccb52f93b444c6c1d5c6777d212b4bdb1ae113"}
Oct 30 10:59:51.226178 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:51.226129    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:51.227009 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:51.226987    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.44:8080/readyz\": dial tcp 10.133.0.44:8080: connect: connection refused"
Oct 30 10:59:51.270862 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:51.270821    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" podStartSLOduration=1.270809291 podStartE2EDuration="1.270809291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:59:51.270021993 +0000 UTC m=+887.615613847" watchObservedRunningTime="2026-10-30 10:59:51.270809291 +0000 UTC m=+887.616401197"
Oct 30 10:59:52.230761 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.230734    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:52.322030 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.321998    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:52.322442 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.322157    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" podUID="acf70085-d565-429c-bb27-596708f1cee4" containerName="ta-container" containerID="cri-o://222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc" gracePeriod=30
Oct 30 10:59:52.562462 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.562437    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:52.610600 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.610572    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\") pod \"acf70085-d565-429c-bb27-596708f1cee4\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") "
Oct 30 10:59:52.610733 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.610603    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\" (UniqueName: \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\") pod \"acf70085-d565-429c-bb27-596708f1cee4\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") "
Oct 30 10:59:52.610733 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.610624    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\") pod \"acf70085-d565-429c-bb27-596708f1cee4\" (UID: \"acf70085-d565-429c-bb27-596708f1cee4\") "
Oct 30 10:59:52.611059 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.611030    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal" pod "acf70085-d565-429c-bb27-596708f1cee4" (UID: "acf70085-d565-429c-bb27-596708f1cee4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:59:52.612739 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.612717    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg" pod "acf70085-d565-429c-bb27-596708f1cee4" (UID: "acf70085-d565-429c-bb27-596708f1cee4"). InnerVolumeSpecName "kube-api-access-l5fcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:59:52.612825 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.612729    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert" pod "acf70085-d565-429c-bb27-596708f1cee4" (UID: "acf70085-d565-429c-bb27-596708f1cee4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:59:52.711936 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.711911    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/acf70085-d565-429c-bb27-596708f1cee4-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:52.711936 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.711933    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5fcg\" (UniqueName: \"kubernetes.io/projected/acf70085-d565-429c-bb27-596708f1cee4-kube-api-access-l5fcg\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:52.712083 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:52.711943    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/acf70085-d565-429c-bb27-596708f1cee4-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:53.234934 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.234897    4488 generic.go:356] "Generic (PLEG): container finished" podID="acf70085-d565-429c-bb27-596708f1cee4" containerID="222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc" exitCode=0
Oct 30 10:59:53.235093 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.234944    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"
Oct 30 10:59:53.235093 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.234979    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" event={"ID":"acf70085-d565-429c-bb27-596708f1cee4","Type":"ContainerDied","Data":"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"}
Oct 30 10:59:53.235093 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.235021    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq" event={"ID":"acf70085-d565-429c-bb27-596708f1cee4","Type":"ContainerDied","Data":"2fb867245e539d0e2416a1422d97c812c60d2eebc4278cc7fa48f6fe58289d34"}
Oct 30 10:59:53.235093 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.235037    4488 scope.go:122] "RemoveContainer" containerID="222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"
Oct 30 10:59:53.243567 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.243553    4488 scope.go:122] "RemoveContainer" containerID="222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"
Oct 30 10:59:53.243782 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:59:53.243760    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc\": container with ID starting with 222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc not found: ID does not exist" containerID="222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"
Oct 30 10:59:53.243824 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.243788    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc"} err="failed to get container status \"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc\": rpc error: code = NotFound desc = could not find container \"222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc\": container with ID starting with 222a425431346e435cd9093c45a9697830f90a14ec4fb5c4834facc9277497cc not found: ID does not exist"
Oct 30 10:59:53.291131 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.291112    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:53.305683 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.305664    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85c58c4998-hhjxq"]
Oct 30 10:59:53.801905 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:53.801869    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="acf70085-d565-429c-bb27-596708f1cee4" path="/var/lib/kubelet/pods/acf70085-d565-429c-bb27-596708f1cee4/volumes"
Oct 30 10:59:55.833282 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.833252    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 10:59:55.833679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.833540    4488 cpu_manager.go:414] "containerMap: removing container" podUID="acf70085-d565-429c-bb27-596708f1cee4" containerName="ta-container"
Oct 30 10:59:55.833679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.833551    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="acf70085-d565-429c-bb27-596708f1cee4" containerName="ta-container"
Oct 30 10:59:55.833679 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.833618    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="acf70085-d565-429c-bb27-596708f1cee4" containerName="ta-container"
Oct 30 10:59:55.837882 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.837865    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:55.870732 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.870708    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 10:59:55.934806 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.934778    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdq45\" (UniqueName: \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:55.934915 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.934817    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:55.934962 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:55.934927    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.035676 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.035644    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdq45\" (UniqueName: \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.035802 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.035696    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.035802 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.035760    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.036392 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.036369    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.038066 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.038046    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.060421 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.060402    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdq45\" (UniqueName: \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\") pod \"data-science-collector-targetallocator-7ff785c899-8ljx9\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.149385 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.149310    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:56.446316 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.446238    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 10:59:56.449007 ip-10-0-132-202 kubenswrapper[4488]: W1030 10:59:56.448979    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8497f47c_c0a3_44e0_92e7_a67fafb847af.slice/crio-645a847c10eee0fecb30b6b76f699b5ccd38e5d670e84939d195b122bf30ee42 WatchSource:0}: Error finding container 645a847c10eee0fecb30b6b76f699b5ccd38e5d670e84939d195b122bf30ee42: Status 404 returned error can't find the container with id 645a847c10eee0fecb30b6b76f699b5ccd38e5d670e84939d195b122bf30ee42
Oct 30 10:59:56.450972 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.450941    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:56.451067 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:56.450993    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 10:59:57.251492 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.251457    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" event={"ID":"8497f47c-c0a3-44e0-92e7-a67fafb847af","Type":"ContainerStarted","Data":"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"}
Oct 30 10:59:57.251492 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.251495    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" event={"ID":"8497f47c-c0a3-44e0-92e7-a67fafb847af","Type":"ContainerStarted","Data":"645a847c10eee0fecb30b6b76f699b5ccd38e5d670e84939d195b122bf30ee42"}
Oct 30 10:59:57.251932 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.251609    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:57.253097 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.253076    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 10:59:57.296726 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.296685    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" podStartSLOduration=2.296674484 podStartE2EDuration="2.296674484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 10:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 10:59:57.29584449 +0000 UTC m=+893.641436344" watchObservedRunningTime="2026-10-30 10:59:57.296674484 +0000 UTC m=+893.642266332"
Oct 30 10:59:57.372867 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.372834    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:57.373031 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.373010    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerName="ta-container" containerID="cri-o://74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec" gracePeriod=30
Oct 30 10:59:57.607282 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.607256    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:57.650089 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.650063    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\") pod \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") "
Oct 30 10:59:57.650238 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.650138    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\") pod \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") "
Oct 30 10:59:57.650325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.650257    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\" (UniqueName: \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\") pod \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\" (UID: \"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7\") "
Oct 30 10:59:57.650556 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.650532    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal" pod "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" (UID: "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 10:59:57.652759 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.652728    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv" pod "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" (UID: "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7"). InnerVolumeSpecName "kube-api-access-k9nsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 10:59:57.653035 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.653014    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert" pod "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" (UID: "f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 10:59:57.751332 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.751308    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:57.751332 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.751330    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:57.751476 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:57.751355    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9nsv\" (UniqueName: \"kubernetes.io/projected/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7-kube-api-access-k9nsv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 10:59:58.256888 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.256851    4488 generic.go:356] "Generic (PLEG): container finished" podID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerID="74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec" exitCode=0
Oct 30 10:59:58.257325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.256890    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"
Oct 30 10:59:58.257325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.256928    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" event={"ID":"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7","Type":"ContainerDied","Data":"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"}
Oct 30 10:59:58.257325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.256967    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j" event={"ID":"f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7","Type":"ContainerDied","Data":"caaf79dd0a2be1c9598d03d1dcccb52f93b444c6c1d5c6777d212b4bdb1ae113"}
Oct 30 10:59:58.257325 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.256983    4488 scope.go:122] "RemoveContainer" containerID="74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"
Oct 30 10:59:58.264759 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.264742    4488 scope.go:122] "RemoveContainer" containerID="74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"
Oct 30 10:59:58.265023 ip-10-0-132-202 kubenswrapper[4488]: E1030 10:59:58.265006    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec\": container with ID starting with 74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec not found: ID does not exist" containerID="74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"
Oct 30 10:59:58.265084 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.265038    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec"} err="failed to get container status \"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec\": rpc error: code = NotFound desc = could not find container \"74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec\": container with ID starting with 74ad2f4db59cad831f60e40a90fa0db611f8f471f27a7e2be8085537997309ec not found: ID does not exist"
Oct 30 10:59:58.311776 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.311749    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:58.325704 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:58.325683    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8575fd789f-zq69j"]
Oct 30 10:59:59.802699 ip-10-0-132-202 kubenswrapper[4488]: I1030 10:59:59.802668    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" path="/var/lib/kubelet/pods/f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7/volumes"
Oct 30 11:00:01.478756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:00:01.478723    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:00:05.601865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.601831    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"]
Oct 30 11:00:05.602265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.602171    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerName="ta-container"
Oct 30 11:00:05.602265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.602193    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerName="ta-container"
Oct 30 11:00:05.602265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.602260    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9d8f2fd-7edd-4e46-ad82-9d51cf711ab7" containerName="ta-container"
Oct 30 11:00:05.606001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.605987    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.626450 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.626423    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"]
Oct 30 11:00:05.708240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.708206    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.708435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.708246    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.708435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.708287    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg6x5\" (UniqueName: \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.809658 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.809627    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.809820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.809665    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.809820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.809727    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg6x5\" (UniqueName: \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.810337 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.810310    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.812274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.812249    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.822293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.822268    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"]
Oct 30 11:00:05.822492 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:00:05.822474    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pg6x5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d" podUID="36fa841c-6e17-471b-b6b1-ca511a2bd9e8"
Oct 30 11:00:05.836623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.836600    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg6x5\" (UniqueName: \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\") pod \"data-science-collector-targetallocator-8657c556cf-ftp7d\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:05.869369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.869297    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:00:05.872449 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.872435    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:05.891097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.891070    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:00:05.910144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.910122    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zlb\" (UniqueName: \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:05.910245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.910153    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:05.910286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:05.910264    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.010780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.010758    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95zlb\" (UniqueName: \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.010882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.010790    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.010882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.010843    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.011550 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.011518    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.013113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.013095    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.035227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.035208    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zlb\" (UniqueName: \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\") pod \"data-science-collector-targetallocator-5dfc65d6d6-5qwtc\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.190216 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.190182    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:06.286086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.286058    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:06.293895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.293873    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:06.413774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.413749    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\") pod \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") "
Oct 30 11:00:06.413912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.413793    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\" (UniqueName: \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\") pod \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") "
Oct 30 11:00:06.413912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.413815    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\" (UniqueName: \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\") pod \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\" (UID: \"36fa841c-6e17-471b-b6b1-ca511a2bd9e8\") "
Oct 30 11:00:06.414230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.414202    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal" pod "36fa841c-6e17-471b-b6b1-ca511a2bd9e8" (UID: "36fa841c-6e17-471b-b6b1-ca511a2bd9e8"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:00:06.415828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.415807    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5" pod "36fa841c-6e17-471b-b6b1-ca511a2bd9e8" (UID: "36fa841c-6e17-471b-b6b1-ca511a2bd9e8"). InnerVolumeSpecName "kube-api-access-pg6x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:00:06.415905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.415809    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert" pod "36fa841c-6e17-471b-b6b1-ca511a2bd9e8" (UID: "36fa841c-6e17-471b-b6b1-ca511a2bd9e8"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:00:06.484007 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.483945    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:00:06.489088 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:00:06.489045    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5216fe4e_86b7_48ef_b6f4_5087c9edca91.slice/crio-ced84d72b11bc2b76d5439bd76fb6eb63aaf39066a949b1b508bb4c050736f5d WatchSource:0}: Error finding container ced84d72b11bc2b76d5439bd76fb6eb63aaf39066a949b1b508bb4c050736f5d: Status 404 returned error can't find the container with id ced84d72b11bc2b76d5439bd76fb6eb63aaf39066a949b1b508bb4c050736f5d
Oct 30 11:00:06.491863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.491831    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:00:06.491932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.491891    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:00:06.514932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.514912    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:06.515010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.514933    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:06.515010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:06.514944    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg6x5\" (UniqueName: \"kubernetes.io/projected/36fa841c-6e17-471b-b6b1-ca511a2bd9e8-kube-api-access-pg6x5\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:07.292198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.292164    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"
Oct 30 11:00:07.292198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.292184    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" event={"ID":"5216fe4e-86b7-48ef-b6f4-5087c9edca91","Type":"ContainerStarted","Data":"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"}
Oct 30 11:00:07.292701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.292227    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" event={"ID":"5216fe4e-86b7-48ef-b6f4-5087c9edca91","Type":"ContainerStarted","Data":"ced84d72b11bc2b76d5439bd76fb6eb63aaf39066a949b1b508bb4c050736f5d"}
Oct 30 11:00:07.292701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.292461    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:07.293908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.293889    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:00:07.353354 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.353304    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" podStartSLOduration=2.3532926180000002 podStartE2EDuration="2.353292618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:00:07.35258701 +0000 UTC m=+903.698178864" watchObservedRunningTime="2026-10-30 11:00:07.353292618 +0000 UTC m=+903.698884471"
Oct 30 11:00:07.419069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.419045    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"]
Oct 30 11:00:07.423296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.423275    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8657c556cf-ftp7d"]
Oct 30 11:00:07.513047 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.513016    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 11:00:07.513214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.513192    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" podUID="8497f47c-c0a3-44e0-92e7-a67fafb847af" containerName="ta-container" containerID="cri-o://e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89" gracePeriod=30
Oct 30 11:00:07.748603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.748580    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 11:00:07.804409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.804382    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36fa841c-6e17-471b-b6b1-ca511a2bd9e8" path="/var/lib/kubelet/pods/36fa841c-6e17-471b-b6b1-ca511a2bd9e8/volumes"
Oct 30 11:00:07.824168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.824145    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\") pod \"8497f47c-c0a3-44e0-92e7-a67fafb847af\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") "
Oct 30 11:00:07.824270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.824176    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\" (UniqueName: \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\") pod \"8497f47c-c0a3-44e0-92e7-a67fafb847af\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") "
Oct 30 11:00:07.824270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.824251    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\") pod \"8497f47c-c0a3-44e0-92e7-a67fafb847af\" (UID: \"8497f47c-c0a3-44e0-92e7-a67fafb847af\") "
Oct 30 11:00:07.824629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.824607    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal" pod "8497f47c-c0a3-44e0-92e7-a67fafb847af" (UID: "8497f47c-c0a3-44e0-92e7-a67fafb847af"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:00:07.826153 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.826134    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45" pod "8497f47c-c0a3-44e0-92e7-a67fafb847af" (UID: "8497f47c-c0a3-44e0-92e7-a67fafb847af"). InnerVolumeSpecName "kube-api-access-qdq45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:00:07.826252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.826234    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert" pod "8497f47c-c0a3-44e0-92e7-a67fafb847af" (UID: "8497f47c-c0a3-44e0-92e7-a67fafb847af"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:00:07.925616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.925592    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8497f47c-c0a3-44e0-92e7-a67fafb847af-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:07.925704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.925616    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdq45\" (UniqueName: \"kubernetes.io/projected/8497f47c-c0a3-44e0-92e7-a67fafb847af-kube-api-access-qdq45\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:07.925704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:07.925633    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8497f47c-c0a3-44e0-92e7-a67fafb847af-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:00:08.296808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.296731    4488 generic.go:356] "Generic (PLEG): container finished" podID="8497f47c-c0a3-44e0-92e7-a67fafb847af" containerID="e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89" exitCode=0
Oct 30 11:00:08.296808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.296776    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"
Oct 30 11:00:08.297262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.296815    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" event={"ID":"8497f47c-c0a3-44e0-92e7-a67fafb847af","Type":"ContainerDied","Data":"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"}
Oct 30 11:00:08.297262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.296856    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9" event={"ID":"8497f47c-c0a3-44e0-92e7-a67fafb847af","Type":"ContainerDied","Data":"645a847c10eee0fecb30b6b76f699b5ccd38e5d670e84939d195b122bf30ee42"}
Oct 30 11:00:08.297262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.296878    4488 scope.go:122] "RemoveContainer" containerID="e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"
Oct 30 11:00:08.305541 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.305525    4488 scope.go:122] "RemoveContainer" containerID="e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"
Oct 30 11:00:08.305812 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:00:08.305795    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89\": container with ID starting with e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89 not found: ID does not exist" containerID="e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"
Oct 30 11:00:08.305859 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.305820    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89"} err="failed to get container status \"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89\": rpc error: code = NotFound desc = could not find container \"e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89\": container with ID starting with e76e6402e9468346121786b206acea2fe72e98d165e8775f13e34be28f253a89 not found: ID does not exist"
Oct 30 11:00:08.352233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.352209    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 11:00:08.356092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.356074    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7ff785c899-8ljx9"]
Oct 30 11:00:08.560950 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.560895    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:00:08.561170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.561158    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8497f47c-c0a3-44e0-92e7-a67fafb847af" containerName="ta-container"
Oct 30 11:00:08.561212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.561170    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8497f47c-c0a3-44e0-92e7-a67fafb847af" containerName="ta-container"
Oct 30 11:00:08.561250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.561236    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8497f47c-c0a3-44e0-92e7-a67fafb847af" containerName="ta-container"
Oct 30 11:00:08.565245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.565226    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.583025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.583003    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-99980381\""
Oct 30 11:00:08.583540 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.583519    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:00:08.583540 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.583523    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:00:08.583764 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.583750    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:00:08.583874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.583860    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8vrjb\""
Oct 30 11:00:08.584680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.584659    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:00:08.629046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.629024    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.629135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.629063    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.629135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.629085    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.629235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.629207    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djq55\" (UniqueName: \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.629280 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.629243    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730005 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.729983    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djq55\" (UniqueName: \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.730012    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.730043    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.730159    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.730205    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.730735 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.730710    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.732325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.732299    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.732429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.732385    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.732470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.732457    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.754701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.754658    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djq55\" (UniqueName: \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\") pod \"data-science-collector-collector-1\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:08.876899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:08.876847    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:00:09.174354 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.174319    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:00:09.176654 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:00:09.176630    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f21966_7572_497d_9b8c_4cd02608e3d8.slice/crio-a71129d8b35622c7e77c7a69c70ca9269114c0638740d4ae6f9c789435a301bc WatchSource:0}: Error finding container a71129d8b35622c7e77c7a69c70ca9269114c0638740d4ae6f9c789435a301bc: Status 404 returned error can't find the container with id a71129d8b35622c7e77c7a69c70ca9269114c0638740d4ae6f9c789435a301bc
Oct 30 11:00:09.178855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.178825    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:00:09.178926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.178882    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:00:09.304532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.304494    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"c0f21966-7572-497d-9b8c-4cd02608e3d8","Type":"ContainerStarted","Data":"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"}
Oct 30 11:00:09.304988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.304565    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"c0f21966-7572-497d-9b8c-4cd02608e3d8","Type":"ContainerStarted","Data":"a71129d8b35622c7e77c7a69c70ca9269114c0638740d4ae6f9c789435a301bc"}
Oct 30 11:00:09.350591 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.350544    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.350529882 podStartE2EDuration="1.350529882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:00:09.349432603 +0000 UTC m=+905.695024462" watchObservedRunningTime="2026-10-30 11:00:09.350529882 +0000 UTC m=+905.696121736"
Oct 30 11:00:09.808092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:00:09.808059    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8497f47c-c0a3-44e0-92e7-a67fafb847af" path="/var/lib/kubelet/pods/8497f47c-c0a3-44e0-92e7-a67fafb847af/volumes"
Oct 30 11:00:31.477270 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:00:31.477227    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:01:01.477703 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:01.477669    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:01:31.477457 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:31.477418    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:01:42.096225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.096194    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:42.096749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.096405    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="c0f21966-7572-497d-9b8c-4cd02608e3d8" containerName="otc-container" containerID="cri-o://55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5" gracePeriod=30
Oct 30 11:01:42.130270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.130241    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"]
Oct 30 11:01:42.133584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.133569    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.154931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.154905    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"]
Oct 30 11:01:42.213422 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.213396    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.213539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.213427    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqlnn\" (UniqueName: \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.213539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.213463    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.314638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.314604    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.314803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.314644    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqlnn\" (UniqueName: \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.314803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.314702    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.315515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.315490    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.316126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.316101    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"]
Oct 30 11:01:42.316269 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:42.316249    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[data-science-collector-ta-server-cert kube-api-access-fqlnn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z" podUID="6b46e761-96c2-42c0-8329-0a397aecae49"
Oct 30 11:01:42.317304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.317283    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.341466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.341443    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqlnn\" (UniqueName: \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\") pod \"data-science-collector-targetallocator-5b9f8c7894-kmv4z\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.361758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.361705    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:42.365076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.365062    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.383718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.383695    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:42.415244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.415221    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.415334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.415255    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.415411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.415358    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8mx\" (UniqueName: \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.516650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.516624    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.516737 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.516662    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.516737 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.516725    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8mx\" (UniqueName: \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.517299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.517279    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.518912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.518894    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.541388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.541365    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8mx\" (UniqueName: \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\") pod \"data-science-collector-targetallocator-789849b59d-mrftc\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.675544 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.675525    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.675624 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.675559    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:42.682229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.682205    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:42.718584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.718550    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\" (UniqueName: \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\") pod \"6b46e761-96c2-42c0-8329-0a397aecae49\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") "
Oct 30 11:01:42.718764 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.718641    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\" (UniqueName: \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\") pod \"6b46e761-96c2-42c0-8329-0a397aecae49\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") "
Oct 30 11:01:42.718764 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.718708    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\") pod \"6b46e761-96c2-42c0-8329-0a397aecae49\" (UID: \"6b46e761-96c2-42c0-8329-0a397aecae49\") "
Oct 30 11:01:42.718988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.718961    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal" pod "6b46e761-96c2-42c0-8329-0a397aecae49" (UID: "6b46e761-96c2-42c0-8329-0a397aecae49"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:01:42.721536 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.721504    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn" pod "6b46e761-96c2-42c0-8329-0a397aecae49" (UID: "6b46e761-96c2-42c0-8329-0a397aecae49"). InnerVolumeSpecName "kube-api-access-fqlnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:01:42.721673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.721570    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert" pod "6b46e761-96c2-42c0-8329-0a397aecae49" (UID: "6b46e761-96c2-42c0-8329-0a397aecae49"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:42.819574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.819537    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6b46e761-96c2-42c0-8329-0a397aecae49-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:42.819574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.819573    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqlnn\" (UniqueName: \"kubernetes.io/projected/6b46e761-96c2-42c0-8329-0a397aecae49-kube-api-access-fqlnn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:42.819574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.819585    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6b46e761-96c2-42c0-8329-0a397aecae49-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:42.975246 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.975208    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:42.977922 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:01:42.977891    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e09704d_348c_4f14_b94a_4e5666f0c6e6.slice/crio-5b2c38b51a2f0760da32e8d35c1e8f329e24118ed7a47f0fc0ed3c85605b86b8 WatchSource:0}: Error finding container 5b2c38b51a2f0760da32e8d35c1e8f329e24118ed7a47f0fc0ed3c85605b86b8: Status 404 returned error can't find the container with id 5b2c38b51a2f0760da32e8d35c1e8f329e24118ed7a47f0fc0ed3c85605b86b8
Oct 30 11:01:42.980072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.980034    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:42.980169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:42.980093    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:43.681310 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.681281    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"
Oct 30 11:01:43.681781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.681302    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" event={"ID":"6e09704d-348c-4f14-b94a-4e5666f0c6e6","Type":"ContainerStarted","Data":"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"}
Oct 30 11:01:43.681781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.681353    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" event={"ID":"6e09704d-348c-4f14-b94a-4e5666f0c6e6","Type":"ContainerStarted","Data":"5b2c38b51a2f0760da32e8d35c1e8f329e24118ed7a47f0fc0ed3c85605b86b8"}
Oct 30 11:01:43.681781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.681462    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:43.683002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.682981    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:43.744050 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.744009    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" podStartSLOduration=1.743998694 podStartE2EDuration="1.743998694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:01:43.743323936 +0000 UTC m=+1000.088915789" watchObservedRunningTime="2026-10-30 11:01:43.743998694 +0000 UTC m=+1000.089590547"
Oct 30 11:01:43.810881 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.810853    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"]
Oct 30 11:01:43.814488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.814464    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b9f8c7894-kmv4z"]
Oct 30 11:01:43.886097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.886072    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:01:43.886248 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:43.886229    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" podUID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" containerName="ta-container" containerID="cri-o://5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7" gracePeriod=30
Oct 30 11:01:44.141333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.141305    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:01:44.231373 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.231324    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\" (UniqueName: \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\") pod \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") "
Oct 30 11:01:44.231498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.231404    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\") pod \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") "
Oct 30 11:01:44.231498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.231452    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\") pod \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\" (UID: \"5216fe4e-86b7-48ef-b6f4-5087c9edca91\") "
Oct 30 11:01:44.231830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.231810    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal" pod "5216fe4e-86b7-48ef-b6f4-5087c9edca91" (UID: "5216fe4e-86b7-48ef-b6f4-5087c9edca91"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:01:44.233489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.233465    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert" pod "5216fe4e-86b7-48ef-b6f4-5087c9edca91" (UID: "5216fe4e-86b7-48ef-b6f4-5087c9edca91"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:44.233548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.233465    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb" pod "5216fe4e-86b7-48ef-b6f4-5087c9edca91" (UID: "5216fe4e-86b7-48ef-b6f4-5087c9edca91"). InnerVolumeSpecName "kube-api-access-95zlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:01:44.332996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.332967    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5216fe4e-86b7-48ef-b6f4-5087c9edca91-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.333078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.333003    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95zlb\" (UniqueName: \"kubernetes.io/projected/5216fe4e-86b7-48ef-b6f4-5087c9edca91-kube-api-access-95zlb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.333078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.333020    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5216fe4e-86b7-48ef-b6f4-5087c9edca91-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.431527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.431506    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.534575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534513    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\") pod \"c0f21966-7572-497d-9b8c-4cd02608e3d8\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") "
Oct 30 11:01:44.534575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534562    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\" (UniqueName: \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\") pod \"c0f21966-7572-497d-9b8c-4cd02608e3d8\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") "
Oct 30 11:01:44.534761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534602    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\") pod \"c0f21966-7572-497d-9b8c-4cd02608e3d8\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") "
Oct 30 11:01:44.534761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534634    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\" (UniqueName: \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\") pod \"c0f21966-7572-497d-9b8c-4cd02608e3d8\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") "
Oct 30 11:01:44.534761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534659    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\") pod \"c0f21966-7572-497d-9b8c-4cd02608e3d8\" (UID: \"c0f21966-7572-497d-9b8c-4cd02608e3d8\") "
Oct 30 11:01:44.535018 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.534992    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal" pod "c0f21966-7572-497d-9b8c-4cd02608e3d8" (UID: "c0f21966-7572-497d-9b8c-4cd02608e3d8"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:01:44.536702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.536676    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs" pod "c0f21966-7572-497d-9b8c-4cd02608e3d8" (UID: "c0f21966-7572-497d-9b8c-4cd02608e3d8"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:44.536788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.536723    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert" pod "c0f21966-7572-497d-9b8c-4cd02608e3d8" (UID: "c0f21966-7572-497d-9b8c-4cd02608e3d8"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:44.536788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.536738    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55" pod "c0f21966-7572-497d-9b8c-4cd02608e3d8" (UID: "c0f21966-7572-497d-9b8c-4cd02608e3d8"). InnerVolumeSpecName "kube-api-access-djq55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:01:44.536788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.536769    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs" pod "c0f21966-7572-497d-9b8c-4cd02608e3d8" (UID: "c0f21966-7572-497d-9b8c-4cd02608e3d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:44.636130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.636103    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.636130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.636126    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c0f21966-7572-497d-9b8c-4cd02608e3d8-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.636252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.636138    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.636252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.636148    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f21966-7572-497d-9b8c-4cd02608e3d8-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.636252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.636157    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djq55\" (UniqueName: \"kubernetes.io/projected/c0f21966-7572-497d-9b8c-4cd02608e3d8-kube-api-access-djq55\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:44.687269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.687237    4488 generic.go:356] "Generic (PLEG): container finished" podID="c0f21966-7572-497d-9b8c-4cd02608e3d8" containerID="55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5" exitCode=0
Oct 30 11:01:44.687632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.687292    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.687632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.687326    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"c0f21966-7572-497d-9b8c-4cd02608e3d8","Type":"ContainerDied","Data":"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"}
Oct 30 11:01:44.687632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.687429    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"c0f21966-7572-497d-9b8c-4cd02608e3d8","Type":"ContainerDied","Data":"a71129d8b35622c7e77c7a69c70ca9269114c0638740d4ae6f9c789435a301bc"}
Oct 30 11:01:44.687632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.687466    4488 scope.go:122] "RemoveContainer" containerID="55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"
Oct 30 11:01:44.688719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.688699    4488 generic.go:356] "Generic (PLEG): container finished" podID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" containerID="5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7" exitCode=0
Oct 30 11:01:44.688812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.688751    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"
Oct 30 11:01:44.688812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.688764    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" event={"ID":"5216fe4e-86b7-48ef-b6f4-5087c9edca91","Type":"ContainerDied","Data":"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"}
Oct 30 11:01:44.688812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.688797    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc" event={"ID":"5216fe4e-86b7-48ef-b6f4-5087c9edca91","Type":"ContainerDied","Data":"ced84d72b11bc2b76d5439bd76fb6eb63aaf39066a949b1b508bb4c050736f5d"}
Oct 30 11:01:44.695649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.695633    4488 scope.go:122] "RemoveContainer" containerID="55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"
Oct 30 11:01:44.695950 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:44.695933    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5\": container with ID starting with 55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5 not found: ID does not exist" containerID="55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"
Oct 30 11:01:44.696002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.695958    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5"} err="failed to get container status \"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5\": rpc error: code = NotFound desc = could not find container \"55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5\": container with ID starting with 55981fff5c8492e7b78a9e3458dbd0a59e0ad72d39d1946cff01971dcfbf12a5 not found: ID does not exist"
Oct 30 11:01:44.696002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.695976    4488 scope.go:122] "RemoveContainer" containerID="5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"
Oct 30 11:01:44.702992 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.702976    4488 scope.go:122] "RemoveContainer" containerID="5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"
Oct 30 11:01:44.703236 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:44.703217    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7\": container with ID starting with 5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7 not found: ID does not exist" containerID="5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"
Oct 30 11:01:44.703294 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.703245    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7"} err="failed to get container status \"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7\": rpc error: code = NotFound desc = could not find container \"5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7\": container with ID starting with 5362b8453c25843dfafc3b487c186861149e89005f0daccccfca66662a4b2dd7 not found: ID does not exist"
Oct 30 11:01:44.744225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.744202    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:44.758109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.758088    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:44.785911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.785762    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:44.786156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786135    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c0f21966-7572-497d-9b8c-4cd02608e3d8" containerName="otc-container"
Oct 30 11:01:44.786221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786159    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0f21966-7572-497d-9b8c-4cd02608e3d8" containerName="otc-container"
Oct 30 11:01:44.786221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786177    4488 cpu_manager.go:414] "containerMap: removing container" podUID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" containerName="ta-container"
Oct 30 11:01:44.786221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786191    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" containerName="ta-container"
Oct 30 11:01:44.786314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786260    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0f21966-7572-497d-9b8c-4cd02608e3d8" containerName="otc-container"
Oct 30 11:01:44.786314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.786270    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" containerName="ta-container"
Oct 30 11:01:44.790466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.790446    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:01:44.790559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.790524    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.795044 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.795027    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dfc65d6d6-5qwtc"]
Oct 30 11:01:44.810852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.810819    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:44.810994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.810950    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:01:44.811074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.811028    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:01:44.811215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.811186    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:01:44.811325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.811287    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8vrjb\""
Oct 30 11:01:44.813245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.813223    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:01:44.837970 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.837945    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.837970 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.837973    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.838111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.837994    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqlxz\" (UniqueName: \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.838111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.838067    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.838175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.838135    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.938957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.938937    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.939069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.938961    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.939069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.938980    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqlxz\" (UniqueName: \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.939069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.939010    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.939069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.939050    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.939738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.939699    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.941472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.941449    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.941552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.941522    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.941593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.941546    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:44.963979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:44.963955    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqlxz\" (UniqueName: \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\") pod \"data-science-collector-collector-1\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:45.103932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.103879    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:01:45.398909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.398807    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:01:45.401103 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:01:45.401074    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb11225f_4100_4706_a272_d93fdb4e387e.slice/crio-9cdb5184df94333ace752123ecb68ca4be762ef5a9f1988cf3064dae27e93f6e WatchSource:0}: Error finding container 9cdb5184df94333ace752123ecb68ca4be762ef5a9f1988cf3064dae27e93f6e: Status 404 returned error can't find the container with id 9cdb5184df94333ace752123ecb68ca4be762ef5a9f1988cf3064dae27e93f6e
Oct 30 11:01:45.403429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.403400    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:45.403501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.403467    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:45.696095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.696057    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"db11225f-4100-4706-a272-d93fdb4e387e","Type":"ContainerStarted","Data":"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"}
Oct 30 11:01:45.696560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.696118    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"db11225f-4100-4706-a272-d93fdb4e387e","Type":"ContainerStarted","Data":"9cdb5184df94333ace752123ecb68ca4be762ef5a9f1988cf3064dae27e93f6e"}
Oct 30 11:01:45.742210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.742152    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.742138709 podStartE2EDuration="1.742138709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:01:45.74161332 +0000 UTC m=+1002.087205174" watchObservedRunningTime="2026-10-30 11:01:45.742138709 +0000 UTC m=+1002.087730564"
Oct 30 11:01:45.803868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.803837    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5216fe4e-86b7-48ef-b6f4-5087c9edca91" path="/var/lib/kubelet/pods/5216fe4e-86b7-48ef-b6f4-5087c9edca91/volumes"
Oct 30 11:01:45.804208 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.804195    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b46e761-96c2-42c0-8329-0a397aecae49" path="/var/lib/kubelet/pods/6b46e761-96c2-42c0-8329-0a397aecae49/volumes"
Oct 30 11:01:45.804475 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:45.804462    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0f21966-7572-497d-9b8c-4cd02608e3d8" path="/var/lib/kubelet/pods/c0f21966-7572-497d-9b8c-4cd02608e3d8/volumes"
Oct 30 11:01:48.459679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.459646    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:01:48.464588 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.464571    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.480703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.480678    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:01:48.564251 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.564224    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcvnb\" (UniqueName: \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.564398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.564258    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.564398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.564284    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.664950 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.664919    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.665071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.665023    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcvnb\" (UniqueName: \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.665071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.665063    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.665670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.665646    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.667258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.667238    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.689962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.689931    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcvnb\" (UniqueName: \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\") pod \"data-science-collector-targetallocator-54df67445d-l97tz\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:48.775922 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:48.775863    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:49.072787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.072711    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:01:49.075472 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:01:49.075444    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef541f06_b53b_4185_9dba_e8cdf38aa266.slice/crio-50416b29de275335a0495444f281387bb597a2940cff3d1cf6db87e20ecf598e WatchSource:0}: Error finding container 50416b29de275335a0495444f281387bb597a2940cff3d1cf6db87e20ecf598e: Status 404 returned error can't find the container with id 50416b29de275335a0495444f281387bb597a2940cff3d1cf6db87e20ecf598e
Oct 30 11:01:49.077787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.077751    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:49.077912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.077816    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:01:49.712524 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.712481    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" event={"ID":"ef541f06-b53b-4185-9dba-e8cdf38aa266","Type":"ContainerStarted","Data":"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"}
Oct 30 11:01:49.712941 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.712534    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" event={"ID":"ef541f06-b53b-4185-9dba-e8cdf38aa266","Type":"ContainerStarted","Data":"50416b29de275335a0495444f281387bb597a2940cff3d1cf6db87e20ecf598e"}
Oct 30 11:01:49.712941 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.712626    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:49.714072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.714053    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:01:49.757948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.757903    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" podStartSLOduration=1.757890183 podStartE2EDuration="1.757890183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:01:49.756835583 +0000 UTC m=+1006.102427447" watchObservedRunningTime="2026-10-30 11:01:49.757890183 +0000 UTC m=+1006.103482036"
Oct 30 11:01:49.833512 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.833482    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:49.833702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:49.833676    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" podUID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" containerName="ta-container" containerID="cri-o://fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f" gracePeriod=30
Oct 30 11:01:50.073063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.073040    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:50.180258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.180229    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\") pod \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") "
Oct 30 11:01:50.180420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.180289    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\" (UniqueName: \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\") pod \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") "
Oct 30 11:01:50.180420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.180315    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\") pod \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\" (UID: \"6e09704d-348c-4f14-b94a-4e5666f0c6e6\") "
Oct 30 11:01:50.180722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.180697    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal" pod "6e09704d-348c-4f14-b94a-4e5666f0c6e6" (UID: "6e09704d-348c-4f14-b94a-4e5666f0c6e6"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:01:50.182103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.182081    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert" pod "6e09704d-348c-4f14-b94a-4e5666f0c6e6" (UID: "6e09704d-348c-4f14-b94a-4e5666f0c6e6"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:01:50.182177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.182160    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx" pod "6e09704d-348c-4f14-b94a-4e5666f0c6e6" (UID: "6e09704d-348c-4f14-b94a-4e5666f0c6e6"). InnerVolumeSpecName "kube-api-access-9v8mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:01:50.280880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.280823    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e09704d-348c-4f14-b94a-4e5666f0c6e6-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:50.280880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.280850    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v8mx\" (UniqueName: \"kubernetes.io/projected/6e09704d-348c-4f14-b94a-4e5666f0c6e6-kube-api-access-9v8mx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:50.280880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.280863    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e09704d-348c-4f14-b94a-4e5666f0c6e6-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:01:50.717859 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.717827    4488 generic.go:356] "Generic (PLEG): container finished" podID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" containerID="fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f" exitCode=0
Oct 30 11:01:50.718250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.717868    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"
Oct 30 11:01:50.718250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.717872    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" event={"ID":"6e09704d-348c-4f14-b94a-4e5666f0c6e6","Type":"ContainerDied","Data":"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"}
Oct 30 11:01:50.718250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.717918    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc" event={"ID":"6e09704d-348c-4f14-b94a-4e5666f0c6e6","Type":"ContainerDied","Data":"5b2c38b51a2f0760da32e8d35c1e8f329e24118ed7a47f0fc0ed3c85605b86b8"}
Oct 30 11:01:50.718250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.717936    4488 scope.go:122] "RemoveContainer" containerID="fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"
Oct 30 11:01:50.726312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.726292    4488 scope.go:122] "RemoveContainer" containerID="fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"
Oct 30 11:01:50.726627 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:01:50.726610    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f\": container with ID starting with fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f not found: ID does not exist" containerID="fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"
Oct 30 11:01:50.726692 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.726635    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f"} err="failed to get container status \"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f\": rpc error: code = NotFound desc = could not find container \"fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f\": container with ID starting with fffbf9007ca59d79fdb2e9f62654797748c08e82b21c937d6a78fb27d7f7de9f not found: ID does not exist"
Oct 30 11:01:50.774217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.774193    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:50.788387 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:50.788364    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-789849b59d-mrftc"]
Oct 30 11:01:51.801995 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:01:51.801964    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" path="/var/lib/kubelet/pods/6e09704d-348c-4f14-b94a-4e5666f0c6e6/volumes"
Oct 30 11:02:01.250416 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.250381    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:01.250790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.250562    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="db11225f-4100-4706-a272-d93fdb4e387e" containerName="otc-container" containerID="cri-o://ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7" gracePeriod=30
Oct 30 11:02:01.452750 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.452719    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:01.453045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.453031    4488 cpu_manager.go:414] "containerMap: removing container" podUID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" containerName="ta-container"
Oct 30 11:02:01.453102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.453046    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" containerName="ta-container"
Oct 30 11:02:01.453157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.453140    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e09704d-348c-4f14-b94a-4e5666f0c6e6" containerName="ta-container"
Oct 30 11:02:01.456129 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.456111    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.474497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.474473    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:01.480859 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:02:01.480832    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:02:01.566606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.566566    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkj6\" (UniqueName: \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.566804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.566779    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.566939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.566919    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.667375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.667333    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.667487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.667379    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkj6\" (UniqueName: \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.667487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.667428    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.668032 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.668010    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.669789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.669772    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.691890 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.691868    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkj6\" (UniqueName: \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\") pod \"data-science-collector-targetallocator-5cc6858979-7q2xd\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:01.767357 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:01.767286    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:02.064152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.064024    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:02.066835 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:02:02.066809    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca4b6e9_912a_4612_94f3_44c906128dd1.slice/crio-5665cf1d027cd41707a748152e724cc37e98672ec86947cf61b54a2d724cb199 WatchSource:0}: Error finding container 5665cf1d027cd41707a748152e724cc37e98672ec86947cf61b54a2d724cb199: Status 404 returned error can't find the container with id 5665cf1d027cd41707a748152e724cc37e98672ec86947cf61b54a2d724cb199
Oct 30 11:02:02.068888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.068854    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:02.068993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.068920    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:02.768136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.768106    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" event={"ID":"dca4b6e9-912a-4612-94f3-44c906128dd1","Type":"ContainerStarted","Data":"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"}
Oct 30 11:02:02.768136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.768143    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" event={"ID":"dca4b6e9-912a-4612-94f3-44c906128dd1","Type":"ContainerStarted","Data":"5665cf1d027cd41707a748152e724cc37e98672ec86947cf61b54a2d724cb199"}
Oct 30 11:02:02.768713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.768378    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:02.769751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.769733    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:02.811757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.811705    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" podStartSLOduration=1.811691844 podStartE2EDuration="1.811691844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:02:02.811564455 +0000 UTC m=+1019.157156334" watchObservedRunningTime="2026-10-30 11:02:02.811691844 +0000 UTC m=+1019.157283701"
Oct 30 11:02:02.886548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.886519    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:02:02.886700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:02.886676    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" podUID="ef541f06-b53b-4185-9dba-e8cdf38aa266" containerName="ta-container" containerID="cri-o://0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5" gracePeriod=30
Oct 30 11:02:03.119921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.119899    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:02:03.180113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.180083    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\" (UniqueName: \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\") pod \"ef541f06-b53b-4185-9dba-e8cdf38aa266\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") "
Oct 30 11:02:03.180253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.180160    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\") pod \"ef541f06-b53b-4185-9dba-e8cdf38aa266\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") "
Oct 30 11:02:03.180253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.180226    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\" (UniqueName: \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\") pod \"ef541f06-b53b-4185-9dba-e8cdf38aa266\" (UID: \"ef541f06-b53b-4185-9dba-e8cdf38aa266\") "
Oct 30 11:02:03.180609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.180585    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal" pod "ef541f06-b53b-4185-9dba-e8cdf38aa266" (UID: "ef541f06-b53b-4185-9dba-e8cdf38aa266"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:02:03.182361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.182322    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb" pod "ef541f06-b53b-4185-9dba-e8cdf38aa266" (UID: "ef541f06-b53b-4185-9dba-e8cdf38aa266"). InnerVolumeSpecName "kube-api-access-wcvnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:02:03.182473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.182365    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert" pod "ef541f06-b53b-4185-9dba-e8cdf38aa266" (UID: "ef541f06-b53b-4185-9dba-e8cdf38aa266"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:02:03.281630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.281605    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcvnb\" (UniqueName: \"kubernetes.io/projected/ef541f06-b53b-4185-9dba-e8cdf38aa266-kube-api-access-wcvnb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.281630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.281628    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ef541f06-b53b-4185-9dba-e8cdf38aa266-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.281757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.281640    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ef541f06-b53b-4185-9dba-e8cdf38aa266-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.572583 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.572559    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.685696 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.685672    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\" (UniqueName: \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\") pod \"db11225f-4100-4706-a272-d93fdb4e387e\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") "
Oct 30 11:02:03.685818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.685710    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\") pod \"db11225f-4100-4706-a272-d93fdb4e387e\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") "
Oct 30 11:02:03.685818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.685737    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\") pod \"db11225f-4100-4706-a272-d93fdb4e387e\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") "
Oct 30 11:02:03.685818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.685760    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\" (UniqueName: \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\") pod \"db11225f-4100-4706-a272-d93fdb4e387e\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") "
Oct 30 11:02:03.685818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.685791    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\") pod \"db11225f-4100-4706-a272-d93fdb4e387e\" (UID: \"db11225f-4100-4706-a272-d93fdb4e387e\") "
Oct 30 11:02:03.686088 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.686060    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal" pod "db11225f-4100-4706-a272-d93fdb4e387e" (UID: "db11225f-4100-4706-a272-d93fdb4e387e"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:02:03.687939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.687913    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs" pod "db11225f-4100-4706-a272-d93fdb4e387e" (UID: "db11225f-4100-4706-a272-d93fdb4e387e"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:02:03.688042 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.687971    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs" pod "db11225f-4100-4706-a272-d93fdb4e387e" (UID: "db11225f-4100-4706-a272-d93fdb4e387e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:02:03.688042 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.687978    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz" pod "db11225f-4100-4706-a272-d93fdb4e387e" (UID: "db11225f-4100-4706-a272-d93fdb4e387e"). InnerVolumeSpecName "kube-api-access-xqlxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:02:03.688042 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.687995    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert" pod "db11225f-4100-4706-a272-d93fdb4e387e" (UID: "db11225f-4100-4706-a272-d93fdb4e387e"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:02:03.773380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.773354    4488 generic.go:356] "Generic (PLEG): container finished" podID="ef541f06-b53b-4185-9dba-e8cdf38aa266" containerID="0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5" exitCode=0
Oct 30 11:02:03.773768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.773409    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"
Oct 30 11:02:03.773768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.773435    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" event={"ID":"ef541f06-b53b-4185-9dba-e8cdf38aa266","Type":"ContainerDied","Data":"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"}
Oct 30 11:02:03.773768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.773480    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz" event={"ID":"ef541f06-b53b-4185-9dba-e8cdf38aa266","Type":"ContainerDied","Data":"50416b29de275335a0495444f281387bb597a2940cff3d1cf6db87e20ecf598e"}
Oct 30 11:02:03.773768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.773500    4488 scope.go:122] "RemoveContainer" containerID="0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"
Oct 30 11:02:03.774840 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.774815    4488 generic.go:356] "Generic (PLEG): container finished" podID="db11225f-4100-4706-a272-d93fdb4e387e" containerID="ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7" exitCode=0
Oct 30 11:02:03.774953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.774878    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.774953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.774901    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"db11225f-4100-4706-a272-d93fdb4e387e","Type":"ContainerDied","Data":"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"}
Oct 30 11:02:03.774953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.774948    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"db11225f-4100-4706-a272-d93fdb4e387e","Type":"ContainerDied","Data":"9cdb5184df94333ace752123ecb68ca4be762ef5a9f1988cf3064dae27e93f6e"}
Oct 30 11:02:03.784098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.784077    4488 scope.go:122] "RemoveContainer" containerID="0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"
Oct 30 11:02:03.784630 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:02:03.784477    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5\": container with ID starting with 0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5 not found: ID does not exist" containerID="0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"
Oct 30 11:02:03.784630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.784515    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5"} err="failed to get container status \"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5\": rpc error: code = NotFound desc = could not find container \"0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5\": container with ID starting with 0b3983807ac5fcba9bbb78652e2d3bd0527da923b8dacfd56d37e0f379762dd5 not found: ID does not exist"
Oct 30 11:02:03.784630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.784543    4488 scope.go:122] "RemoveContainer" containerID="ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"
Oct 30 11:02:03.786299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.786261    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.786299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.786284    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqlxz\" (UniqueName: \"kubernetes.io/projected/db11225f-4100-4706-a272-d93fdb4e387e-kube-api-access-xqlxz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.786299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.786299    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.786878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.786329    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/db11225f-4100-4706-a272-d93fdb4e387e-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.786878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.786356    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/db11225f-4100-4706-a272-d93fdb4e387e-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:03.792189 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.792170    4488 scope.go:122] "RemoveContainer" containerID="ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"
Oct 30 11:02:03.792464 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:02:03.792441    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7\": container with ID starting with ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7 not found: ID does not exist" containerID="ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"
Oct 30 11:02:03.792530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.792472    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7"} err="failed to get container status \"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7\": rpc error: code = NotFound desc = could not find container \"ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7\": container with ID starting with ad2a775f36cdd63a575c851c5e7a28c47353796dc6d00590febf0a4d8a645ea7 not found: ID does not exist"
Oct 30 11:02:03.830686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.830664    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:03.834816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.834795    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:03.873536 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.873510    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:02:03.874457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874437    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:03.874774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874758    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ef541f06-b53b-4185-9dba-e8cdf38aa266" containerName="ta-container"
Oct 30 11:02:03.874851 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874776    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef541f06-b53b-4185-9dba-e8cdf38aa266" containerName="ta-container"
Oct 30 11:02:03.874851 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874809    4488 cpu_manager.go:414] "containerMap: removing container" podUID="db11225f-4100-4706-a272-d93fdb4e387e" containerName="otc-container"
Oct 30 11:02:03.874851 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874818    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db11225f-4100-4706-a272-d93fdb4e387e" containerName="otc-container"
Oct 30 11:02:03.875008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874900    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef541f06-b53b-4185-9dba-e8cdf38aa266" containerName="ta-container"
Oct 30 11:02:03.875008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.874916    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="db11225f-4100-4706-a272-d93fdb4e387e" containerName="otc-container"
Oct 30 11:02:03.879293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.879275    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.881670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.881646    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54df67445d-l97tz"]
Oct 30 11:02:03.894953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.894933    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:03.896139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.896117    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:02:03.896252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.896221    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8vrjb\""
Oct 30 11:02:03.896376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.896356    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:02:03.896502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.896486    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:02:03.896554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.896532    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:02:03.988772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.988748    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.988866 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.988789    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsg7\" (UniqueName: \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.988866 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.988815    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.988946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.988925    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:03.988982 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:03.988948    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.089550 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.089526    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.089673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.089560    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsg7\" (UniqueName: \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.089673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.089589    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.089673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.089628    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.089673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.089644    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.090304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.090284    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.091981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.091959    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.092071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.092014    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.092071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.092013    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.113895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.113875    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsg7\" (UniqueName: \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\") pod \"data-science-collector-collector-1\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.191207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.191184    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:02:04.487534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.487508    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:02:04.489952 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:02:04.489923    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff3ced6_2502_4af1_9c91_48ff6b046cb4.slice/crio-ce3997d406fe031cd53bac1b1aab940710ddf1e0117719a711545f60f31c10c9 WatchSource:0}: Error finding container ce3997d406fe031cd53bac1b1aab940710ddf1e0117719a711545f60f31c10c9: Status 404 returned error can't find the container with id ce3997d406fe031cd53bac1b1aab940710ddf1e0117719a711545f60f31c10c9
Oct 30 11:02:04.492158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.492132    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:04.492215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.492190    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:04.781372 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.781264    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bff3ced6-2502-4af1-9c91-48ff6b046cb4","Type":"ContainerStarted","Data":"cf9da08e65e78f57781ce43e6767300deeac16d5d6c86b805fa4a6ff196d0d8c"}
Oct 30 11:02:04.781372 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.781324    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bff3ced6-2502-4af1-9c91-48ff6b046cb4","Type":"ContainerStarted","Data":"ce3997d406fe031cd53bac1b1aab940710ddf1e0117719a711545f60f31c10c9"}
Oct 30 11:02:04.826306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:04.826255    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.8262382879999999 podStartE2EDuration="1.826238288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:02:04.825934893 +0000 UTC m=+1021.171526738" watchObservedRunningTime="2026-10-30 11:02:04.826238288 +0000 UTC m=+1021.171830145"
Oct 30 11:02:05.802713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:05.802678    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db11225f-4100-4706-a272-d93fdb4e387e" path="/var/lib/kubelet/pods/db11225f-4100-4706-a272-d93fdb4e387e/volumes"
Oct 30 11:02:05.803239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:05.803215    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef541f06-b53b-4185-9dba-e8cdf38aa266" path="/var/lib/kubelet/pods/ef541f06-b53b-4185-9dba-e8cdf38aa266/volumes"
Oct 30 11:02:06.943151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:06.943118    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:02:06.947384 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:06.947367    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:06.965113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:06.965084    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:02:07.011096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.011070    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qp79\" (UniqueName: \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.011239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.011105    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.011239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.011126    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.111958 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.111929    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qp79\" (UniqueName: \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.112096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.111971    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.112096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.111999    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.112536 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.112519    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.114257 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.114229    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.136234 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.136206    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qp79\" (UniqueName: \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\") pod \"data-science-collector-targetallocator-76cf88fcd8-dlhmq\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.259223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.259151    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.557314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.557240    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:02:07.560002 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:02:07.559978    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5490c8e_a468_40b5_8438_f29da2ceaaa1.slice/crio-48de4ae71b2e2628f864d9b46b94b2b7d7a47433f430d30ea7dec37f78af06e3 WatchSource:0}: Error finding container 48de4ae71b2e2628f864d9b46b94b2b7d7a47433f430d30ea7dec37f78af06e3: Status 404 returned error can't find the container with id 48de4ae71b2e2628f864d9b46b94b2b7d7a47433f430d30ea7dec37f78af06e3
Oct 30 11:02:07.562314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.562281    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:07.562418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.562334    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:02:07.795252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.795220    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" event={"ID":"e5490c8e-a468-40b5-8438-f29da2ceaaa1","Type":"ContainerStarted","Data":"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"}
Oct 30 11:02:07.795252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.795260    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" event={"ID":"e5490c8e-a468-40b5-8438-f29da2ceaaa1","Type":"ContainerStarted","Data":"48de4ae71b2e2628f864d9b46b94b2b7d7a47433f430d30ea7dec37f78af06e3"}
Oct 30 11:02:07.795506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.795433    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:07.796549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.796526    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.55:8080/readyz\": dial tcp 10.133.0.55:8080: connect: connection refused"
Oct 30 11:02:07.839928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:07.839854    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" podStartSLOduration=1.839842505 podStartE2EDuration="1.839842505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:02:07.838871031 +0000 UTC m=+1024.184462884" watchObservedRunningTime="2026-10-30 11:02:07.839842505 +0000 UTC m=+1024.185434359"
Oct 30 11:02:08.800114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:08.800088    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:02:08.872191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:08.872161    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:08.872398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:08.872372    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" podUID="dca4b6e9-912a-4612-94f3-44c906128dd1" containerName="ta-container" containerID="cri-o://8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d" gracePeriod=30
Oct 30 11:02:09.110677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.110656    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:09.228499 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.228474    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\" (UniqueName: \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\") pod \"dca4b6e9-912a-4612-94f3-44c906128dd1\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") "
Oct 30 11:02:09.228642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.228531    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\" (UniqueName: \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\") pod \"dca4b6e9-912a-4612-94f3-44c906128dd1\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") "
Oct 30 11:02:09.228642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.228594    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\") pod \"dca4b6e9-912a-4612-94f3-44c906128dd1\" (UID: \"dca4b6e9-912a-4612-94f3-44c906128dd1\") "
Oct 30 11:02:09.228927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.228896    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal" pod "dca4b6e9-912a-4612-94f3-44c906128dd1" (UID: "dca4b6e9-912a-4612-94f3-44c906128dd1"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:02:09.230514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.230483    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert" pod "dca4b6e9-912a-4612-94f3-44c906128dd1" (UID: "dca4b6e9-912a-4612-94f3-44c906128dd1"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:02:09.230602 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.230532    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6" pod "dca4b6e9-912a-4612-94f3-44c906128dd1" (UID: "dca4b6e9-912a-4612-94f3-44c906128dd1"). InnerVolumeSpecName "kube-api-access-jbkj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:02:09.329352 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.329328    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/dca4b6e9-912a-4612-94f3-44c906128dd1-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:09.329453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.329366    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbkj6\" (UniqueName: \"kubernetes.io/projected/dca4b6e9-912a-4612-94f3-44c906128dd1-kube-api-access-jbkj6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:09.329453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.329377    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/dca4b6e9-912a-4612-94f3-44c906128dd1-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:02:09.804513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.804477    4488 generic.go:356] "Generic (PLEG): container finished" podID="dca4b6e9-912a-4612-94f3-44c906128dd1" containerID="8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d" exitCode=0
Oct 30 11:02:09.804966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.804524    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"
Oct 30 11:02:09.804966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.804557    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" event={"ID":"dca4b6e9-912a-4612-94f3-44c906128dd1","Type":"ContainerDied","Data":"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"}
Oct 30 11:02:09.804966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.804607    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd" event={"ID":"dca4b6e9-912a-4612-94f3-44c906128dd1","Type":"ContainerDied","Data":"5665cf1d027cd41707a748152e724cc37e98672ec86947cf61b54a2d724cb199"}
Oct 30 11:02:09.804966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.804632    4488 scope.go:122] "RemoveContainer" containerID="8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"
Oct 30 11:02:09.813645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.813624    4488 scope.go:122] "RemoveContainer" containerID="8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"
Oct 30 11:02:09.813913 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:02:09.813895    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d\": container with ID starting with 8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d not found: ID does not exist" containerID="8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"
Oct 30 11:02:09.813956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.813921    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d"} err="failed to get container status \"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d\": rpc error: code = NotFound desc = could not find container \"8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d\": container with ID starting with 8152084e533ae3b234096003e47f47ddbc3622d1a438abf10fa7cfb4e806af8d not found: ID does not exist"
Oct 30 11:02:09.858889 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.858868    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:09.872855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:09.872834    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-7q2xd"]
Oct 30 11:02:11.802961 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:11.802927    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dca4b6e9-912a-4612-94f3-44c906128dd1" path="/var/lib/kubelet/pods/dca4b6e9-912a-4612-94f3-44c906128dd1/volumes"
Oct 30 11:02:31.478450 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:02:31.478371    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:02:48.443875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.443841    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:02:48.444323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.444148    4488 cpu_manager.go:414] "containerMap: removing container" podUID="dca4b6e9-912a-4612-94f3-44c906128dd1" containerName="ta-container"
Oct 30 11:02:48.444323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.444160    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dca4b6e9-912a-4612-94f3-44c906128dd1" containerName="ta-container"
Oct 30 11:02:48.444323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.444221    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="dca4b6e9-912a-4612-94f3-44c906128dd1" containerName="ta-container"
Oct 30 11:02:48.447350 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.447325    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 11:02:48.460779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.460758    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:02:48.473428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.473410    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-otlp-identity\"/\"default-dockercfg-fz4l6\""
Oct 30 11:02:48.478110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.478092    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 11:02:48.772368 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.772332    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:02:48.774832 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:02:48.774806    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf4db738_22ea_47fa_8846_ab48efac7291.slice/crio-578589987a8f9fc4718c1061c113c4eb81f64b63e6d82d966d0175f0fc050705 WatchSource:0}: Error finding container 578589987a8f9fc4718c1061c113c4eb81f64b63e6d82d966d0175f0fc050705: Status 404 returned error can't find the container with id 578589987a8f9fc4718c1061c113c4eb81f64b63e6d82d966d0175f0fc050705
Oct 30 11:02:48.949836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.949804    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"df4db738-22ea-47fa-8846-ab48efac7291","Type":"ContainerStarted","Data":"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"}
Oct 30 11:02:48.949935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.949848    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"df4db738-22ea-47fa-8846-ab48efac7291","Type":"ContainerStarted","Data":"578589987a8f9fc4718c1061c113c4eb81f64b63e6d82d966d0175f0fc050705"}
Oct 30 11:02:48.999078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:02:48.995094    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podStartSLOduration=0.995077026 podStartE2EDuration="995.077026ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:02:48.993079338 +0000 UTC m=+1065.338671193" watchObservedRunningTime="2026-10-30 11:02:48.995077026 +0000 UTC m=+1065.340668881"
Oct 30 11:03:01.477715 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:03:01.477676    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:03:03.973813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:03:03.973788    4488 scope.go:122] "RemoveContainer" containerID="0f2e9e13d67592b09603c0741cfabb6ca3b73bff11ff075c31ee96244db6e0b7"
Oct 30 11:03:31.478499 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:03:31.478462    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:04:01.477582 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:04:01.477532    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:04:31.478078 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:04:31.478041    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:05:01.478690 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:01.478653    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:05:09.399257 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:09.399226    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:05:09.399791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:09.399426    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podUID="df4db738-22ea-47fa-8846-ab48efac7291" containerName="otlp-spoof-probe" containerID="cri-o://ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd" gracePeriod=30
Oct 30 11:05:31.477927 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:31.477841    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:05:39.541980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.541957    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 11:05:39.617905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.617875    4488 generic.go:356] "Generic (PLEG): container finished" podID="df4db738-22ea-47fa-8846-ab48efac7291" containerID="ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd" exitCode=137
Oct 30 11:05:39.618040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.617918    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 11:05:39.618040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.617957    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"df4db738-22ea-47fa-8846-ab48efac7291","Type":"ContainerDied","Data":"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"}
Oct 30 11:05:39.618040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.617996    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"df4db738-22ea-47fa-8846-ab48efac7291","Type":"ContainerDied","Data":"578589987a8f9fc4718c1061c113c4eb81f64b63e6d82d966d0175f0fc050705"}
Oct 30 11:05:39.618040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.618014    4488 scope.go:122] "RemoveContainer" containerID="ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"
Oct 30 11:05:39.625804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.625730    4488 scope.go:122] "RemoveContainer" containerID="ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"
Oct 30 11:05:39.626050 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:39.626033    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd\": container with ID starting with ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd not found: ID does not exist" containerID="ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"
Oct 30 11:05:39.626112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.626057    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd"} err="failed to get container status \"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd\": rpc error: code = NotFound desc = could not find container \"ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd\": container with ID starting with ea6cc26985e335bc5831bc26b56c022d7acbda8861d94c7427e603bec41a0ffd not found: ID does not exist"
Oct 30 11:05:39.672427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.672403    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:05:39.676368 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.676324    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 11:05:39.802825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:39.802802    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df4db738-22ea-47fa-8846-ab48efac7291" path="/var/lib/kubelet/pods/df4db738-22ea-47fa-8846-ab48efac7291/volumes"
Oct 30 11:05:42.153200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.153168    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:42.153670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.153529    4488 cpu_manager.go:414] "containerMap: removing container" podUID="df4db738-22ea-47fa-8846-ab48efac7291" containerName="otlp-spoof-probe"
Oct 30 11:05:42.153670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.153544    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df4db738-22ea-47fa-8846-ab48efac7291" containerName="otlp-spoof-probe"
Oct 30 11:05:42.153670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.153602    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="df4db738-22ea-47fa-8846-ab48efac7291" containerName="otlp-spoof-probe"
Oct 30 11:05:42.157731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.157714    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.174198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.174178    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:42.257217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.257196    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr98w\" (UniqueName: \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.257388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.257231    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.257388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.257257    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.358232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.358202    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.358315 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.358244    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.358315 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.358291    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr98w\" (UniqueName: \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.358872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.358850    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.360614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.360593    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.384707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.384685    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr98w\" (UniqueName: \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\") pod \"data-science-collector-targetallocator-8f865d777-mwgnw\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.468688 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.468667    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:42.763865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.763796    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:42.766624 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:05:42.766596    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81dad498_7998_4b34_ac04_349c607affa4.slice/crio-27d2b87011792c04ba819f0a2297ee4a056052df80b1184338d9e37a69377d9c WatchSource:0}: Error finding container 27d2b87011792c04ba819f0a2297ee4a056052df80b1184338d9e37a69377d9c: Status 404 returned error can't find the container with id 27d2b87011792c04ba819f0a2297ee4a056052df80b1184338d9e37a69377d9c
Oct 30 11:05:42.768604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.768573    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:42.768703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:42.768628    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:43.635647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.635615    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" event={"ID":"81dad498-7998-4b34-ac04-349c607affa4","Type":"ContainerStarted","Data":"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"}
Oct 30 11:05:43.635647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.635653    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" event={"ID":"81dad498-7998-4b34-ac04-349c607affa4","Type":"ContainerStarted","Data":"27d2b87011792c04ba819f0a2297ee4a056052df80b1184338d9e37a69377d9c"}
Oct 30 11:05:43.636162 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.635900    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:43.637191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.637173    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:43.679564 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.679520    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" podStartSLOduration=1.6795065500000002 podStartE2EDuration="1.67950655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:05:43.678963664 +0000 UTC m=+1240.024555518" watchObservedRunningTime="2026-10-30 11:05:43.67950655 +0000 UTC m=+1240.025098451"
Oct 30 11:05:43.752297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.752270    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:05:43.752495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.752474    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerName="ta-container" containerID="cri-o://115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70" gracePeriod=30
Oct 30 11:05:43.987747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:43.987723    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:05:44.171240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.171212    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\" (UniqueName: \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\") pod \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") "
Oct 30 11:05:44.171429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.171285    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\" (UniqueName: \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\") pod \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") "
Oct 30 11:05:44.171429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.171354    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\") pod \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\" (UID: \"e5490c8e-a468-40b5-8438-f29da2ceaaa1\") "
Oct 30 11:05:44.171653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.171620    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal" pod "e5490c8e-a468-40b5-8438-f29da2ceaaa1" (UID: "e5490c8e-a468-40b5-8438-f29da2ceaaa1"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:05:44.173787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.173760    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79" pod "e5490c8e-a468-40b5-8438-f29da2ceaaa1" (UID: "e5490c8e-a468-40b5-8438-f29da2ceaaa1"). InnerVolumeSpecName "kube-api-access-6qp79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:05:44.175448 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.175422    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert" pod "e5490c8e-a468-40b5-8438-f29da2ceaaa1" (UID: "e5490c8e-a468-40b5-8438-f29da2ceaaa1"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:05:44.272843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.272824    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qp79\" (UniqueName: \"kubernetes.io/projected/e5490c8e-a468-40b5-8438-f29da2ceaaa1-kube-api-access-6qp79\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:44.272926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.272845    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/e5490c8e-a468-40b5-8438-f29da2ceaaa1-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:44.272926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.272856    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/e5490c8e-a468-40b5-8438-f29da2ceaaa1-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:44.640191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.640134    4488 generic.go:356] "Generic (PLEG): container finished" podID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerID="115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70" exitCode=0
Oct 30 11:05:44.640191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.640174    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"
Oct 30 11:05:44.640579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.640218    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" event={"ID":"e5490c8e-a468-40b5-8438-f29da2ceaaa1","Type":"ContainerDied","Data":"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"}
Oct 30 11:05:44.640579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.640259    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq" event={"ID":"e5490c8e-a468-40b5-8438-f29da2ceaaa1","Type":"ContainerDied","Data":"48de4ae71b2e2628f864d9b46b94b2b7d7a47433f430d30ea7dec37f78af06e3"}
Oct 30 11:05:44.640579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.640281    4488 scope.go:122] "RemoveContainer" containerID="115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"
Oct 30 11:05:44.649030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.649015    4488 scope.go:122] "RemoveContainer" containerID="115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"
Oct 30 11:05:44.649288 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:44.649272    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70\": container with ID starting with 115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70 not found: ID does not exist" containerID="115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"
Oct 30 11:05:44.649334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.649296    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70"} err="failed to get container status \"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70\": rpc error: code = NotFound desc = could not find container \"115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70\": container with ID starting with 115749e9cf3476492dc9b29b757f586e69c3567bce14b379bbee158630db4a70 not found: ID does not exist"
Oct 30 11:05:44.695465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.695441    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:05:44.709410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:44.709387    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76cf88fcd8-dlhmq"]
Oct 30 11:05:45.802710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:45.802680    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" path="/var/lib/kubelet/pods/e5490c8e-a468-40b5-8438-f29da2ceaaa1/volumes"
Oct 30 11:05:49.532160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.532123    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:49.532585 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.532571    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerName="ta-container"
Oct 30 11:05:49.532643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.532592    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerName="ta-container"
Oct 30 11:05:49.532723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.532707    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5490c8e-a468-40b5-8438-f29da2ceaaa1" containerName="ta-container"
Oct 30 11:05:49.537134 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.537113    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.568661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.568636    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:49.714473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.714446    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztfl\" (UniqueName: \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.714588 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.714507    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.714644 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.714606    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.814989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.814927    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztfl\" (UniqueName: \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.814989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.814981    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.815206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.815184    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.815681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.815663    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.817485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.817464    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.839543 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.839517    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztfl\" (UniqueName: \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\") pod \"data-science-collector-targetallocator-6586f8d55d-vvhlr\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:49.848370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:49.848333    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:50.146720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.146620    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:50.150289 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:05:50.150262    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e4c845a_6b16_45aa_bcfd_57dd8573d385.slice/crio-a983fb5308c43103273714a7365641990ca55315cfc26ea3744e50a2204a76f0 WatchSource:0}: Error finding container a983fb5308c43103273714a7365641990ca55315cfc26ea3744e50a2204a76f0: Status 404 returned error can't find the container with id a983fb5308c43103273714a7365641990ca55315cfc26ea3744e50a2204a76f0
Oct 30 11:05:50.152818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.152778    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:50.152893 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.152851    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:50.668215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.668180    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" event={"ID":"6e4c845a-6b16-45aa-bcfd-57dd8573d385","Type":"ContainerStarted","Data":"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"}
Oct 30 11:05:50.668215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.668219    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" event={"ID":"6e4c845a-6b16-45aa-bcfd-57dd8573d385","Type":"ContainerStarted","Data":"a983fb5308c43103273714a7365641990ca55315cfc26ea3744e50a2204a76f0"}
Oct 30 11:05:50.668685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.668360    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:50.669955 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.669937    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:50.712419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.712372    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" podStartSLOduration=1.712360264 podStartE2EDuration="1.712360264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:05:50.71192859 +0000 UTC m=+1247.057520494" watchObservedRunningTime="2026-10-30 11:05:50.712360264 +0000 UTC m=+1247.057952109"
Oct 30 11:05:50.785319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.785294    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:50.785503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:50.785480    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" podUID="81dad498-7998-4b34-ac04-349c607affa4" containerName="ta-container" containerID="cri-o://3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95" gracePeriod=30
Oct 30 11:05:51.021947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.021923    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:51.024959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.024943    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\") pod \"81dad498-7998-4b34-ac04-349c607affa4\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") "
Oct 30 11:05:51.025027 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.024993    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\" (UniqueName: \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\") pod \"81dad498-7998-4b34-ac04-349c607affa4\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") "
Oct 30 11:05:51.025027 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.025015    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\") pod \"81dad498-7998-4b34-ac04-349c607affa4\" (UID: \"81dad498-7998-4b34-ac04-349c607affa4\") "
Oct 30 11:05:51.025353 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.025313    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal" pod "81dad498-7998-4b34-ac04-349c607affa4" (UID: "81dad498-7998-4b34-ac04-349c607affa4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:05:51.026906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.026887    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w" pod "81dad498-7998-4b34-ac04-349c607affa4" (UID: "81dad498-7998-4b34-ac04-349c607affa4"). InnerVolumeSpecName "kube-api-access-vr98w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:05:51.026996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.026922    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert" pod "81dad498-7998-4b34-ac04-349c607affa4" (UID: "81dad498-7998-4b34-ac04-349c607affa4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:05:51.126103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.126074    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr98w\" (UniqueName: \"kubernetes.io/projected/81dad498-7998-4b34-ac04-349c607affa4-kube-api-access-vr98w\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:51.126103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.126100    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81dad498-7998-4b34-ac04-349c607affa4-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:51.126281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.126110    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81dad498-7998-4b34-ac04-349c607affa4-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:51.675394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.675360    4488 generic.go:356] "Generic (PLEG): container finished" podID="81dad498-7998-4b34-ac04-349c607affa4" containerID="3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95" exitCode=0
Oct 30 11:05:51.675791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.675414    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"
Oct 30 11:05:51.675791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.675447    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" event={"ID":"81dad498-7998-4b34-ac04-349c607affa4","Type":"ContainerDied","Data":"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"}
Oct 30 11:05:51.675791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.675484    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw" event={"ID":"81dad498-7998-4b34-ac04-349c607affa4","Type":"ContainerDied","Data":"27d2b87011792c04ba819f0a2297ee4a056052df80b1184338d9e37a69377d9c"}
Oct 30 11:05:51.675791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.675504    4488 scope.go:122] "RemoveContainer" containerID="3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"
Oct 30 11:05:51.683700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.683686    4488 scope.go:122] "RemoveContainer" containerID="3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"
Oct 30 11:05:51.683988 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:51.683968    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95\": container with ID starting with 3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95 not found: ID does not exist" containerID="3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"
Oct 30 11:05:51.684028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.683996    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95"} err="failed to get container status \"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95\": rpc error: code = NotFound desc = could not find container \"3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95\": container with ID starting with 3592b9a5aba7d9f70dc5dec0d6dd0cefb6d6e946d238dc2ae156c26018d13c95 not found: ID does not exist"
Oct 30 11:05:51.731136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.731117    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:51.744987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.744969    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8f865d777-mwgnw"]
Oct 30 11:05:51.802402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:51.802381    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81dad498-7998-4b34-ac04-349c607affa4" path="/var/lib/kubelet/pods/81dad498-7998-4b34-ac04-349c607affa4/volumes"
Oct 30 11:05:55.054710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.054680    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:05:55.055077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.054984    4488 cpu_manager.go:414] "containerMap: removing container" podUID="81dad498-7998-4b34-ac04-349c607affa4" containerName="ta-container"
Oct 30 11:05:55.055077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.054995    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81dad498-7998-4b34-ac04-349c607affa4" containerName="ta-container"
Oct 30 11:05:55.055077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.055043    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="81dad498-7998-4b34-ac04-349c607affa4" containerName="ta-container"
Oct 30 11:05:55.057872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.057855    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.089723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.089700    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:05:55.147346 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.147319    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdkhx\" (UniqueName: \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.147468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.147379    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.147510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.147464    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.247882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.247859    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.247960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.247909    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdkhx\" (UniqueName: \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.247960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.247938    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.248607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.248586    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.250186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.250164    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.272423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.272406    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdkhx\" (UniqueName: \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\") pod \"data-science-collector-targetallocator-5cc6858979-rc54w\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.368470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.368419    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:55.663912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.663887    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:05:55.666459 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:05:55.666430    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b7ea54d_8f79_461c_a21c_92e868750586.slice/crio-fbe5b9fc81f43b1f480f0a56fb1d59c020938919c7267d93df2db149dacbca0e WatchSource:0}: Error finding container fbe5b9fc81f43b1f480f0a56fb1d59c020938919c7267d93df2db149dacbca0e: Status 404 returned error can't find the container with id fbe5b9fc81f43b1f480f0a56fb1d59c020938919c7267d93df2db149dacbca0e
Oct 30 11:05:55.668452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.668418    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:55.668539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.668474    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:05:55.692441 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:55.692420    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" event={"ID":"2b7ea54d-8f79-461c-a21c-92e868750586","Type":"ContainerStarted","Data":"fbe5b9fc81f43b1f480f0a56fb1d59c020938919c7267d93df2db149dacbca0e"}
Oct 30 11:05:56.698108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.698069    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" event={"ID":"2b7ea54d-8f79-461c-a21c-92e868750586","Type":"ContainerStarted","Data":"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"}
Oct 30 11:05:56.698531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.698222    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:56.700097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.700078    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:05:56.741907 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.741859    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" podStartSLOduration=1.741846768 podStartE2EDuration="1.741846768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:05:56.741309273 +0000 UTC m=+1253.086901127" watchObservedRunningTime="2026-10-30 11:05:56.741846768 +0000 UTC m=+1253.087438621"
Oct 30 11:05:56.814975 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.814944    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:56.815145 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:56.815080    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" podUID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" containerName="ta-container" containerID="cri-o://8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5" gracePeriod=30
Oct 30 11:05:57.047902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.047879    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:57.059600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.059575    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\") pod \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") "
Oct 30 11:05:57.059722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.059625    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\" (UniqueName: \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\") pod \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") "
Oct 30 11:05:57.061482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.061460    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert" pod "6e4c845a-6b16-45aa-bcfd-57dd8573d385" (UID: "6e4c845a-6b16-45aa-bcfd-57dd8573d385"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:05:57.061584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.061565    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl" pod "6e4c845a-6b16-45aa-bcfd-57dd8573d385" (UID: "6e4c845a-6b16-45aa-bcfd-57dd8573d385"). InnerVolumeSpecName "kube-api-access-kztfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:05:57.160095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.160067    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\") pod \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\" (UID: \"6e4c845a-6b16-45aa-bcfd-57dd8573d385\") "
Oct 30 11:05:57.160241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.160229    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/6e4c845a-6b16-45aa-bcfd-57dd8573d385-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:57.160282 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.160245    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kztfl\" (UniqueName: \"kubernetes.io/projected/6e4c845a-6b16-45aa-bcfd-57dd8573d385-kube-api-access-kztfl\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:57.160413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.160394    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal" pod "6e4c845a-6b16-45aa-bcfd-57dd8573d385" (UID: "6e4c845a-6b16-45aa-bcfd-57dd8573d385"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:05:57.261135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.261074    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/6e4c845a-6b16-45aa-bcfd-57dd8573d385-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:05:57.703700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.703672    4488 generic.go:356] "Generic (PLEG): container finished" podID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" containerID="8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5" exitCode=0
Oct 30 11:05:57.704073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.703731    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"
Oct 30 11:05:57.704073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.703758    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" event={"ID":"6e4c845a-6b16-45aa-bcfd-57dd8573d385","Type":"ContainerDied","Data":"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"}
Oct 30 11:05:57.704073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.703799    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr" event={"ID":"6e4c845a-6b16-45aa-bcfd-57dd8573d385","Type":"ContainerDied","Data":"a983fb5308c43103273714a7365641990ca55315cfc26ea3744e50a2204a76f0"}
Oct 30 11:05:57.704073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.703816    4488 scope.go:122] "RemoveContainer" containerID="8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"
Oct 30 11:05:57.712296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.712281    4488 scope.go:122] "RemoveContainer" containerID="8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"
Oct 30 11:05:57.712644 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:05:57.712624    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5\": container with ID starting with 8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5 not found: ID does not exist" containerID="8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"
Oct 30 11:05:57.712685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.712652    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5"} err="failed to get container status \"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5\": rpc error: code = NotFound desc = could not find container \"8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5\": container with ID starting with 8f160e4709c7a9c6eca6a56bfa6aa92128271fe5d7e75114b1b9f66ea058a2e5 not found: ID does not exist"
Oct 30 11:05:57.785600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.785580    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:57.805483 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:57.805454    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6586f8d55d-vvhlr"]
Oct 30 11:05:59.802701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:05:59.802668    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" path="/var/lib/kubelet/pods/6e4c845a-6b16-45aa-bcfd-57dd8573d385/volumes"
Oct 30 11:06:01.478321 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:06:01.478285    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:06:02.422943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.422908    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:06:02.423138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.423117    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" containerName="otc-container" containerID="cri-o://cf9da08e65e78f57781ce43e6767300deeac16d5d6c86b805fa4a6ff196d0d8c" gracePeriod=30
Oct 30 11:06:02.621873 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.621844    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:02.622231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.622158    4488 cpu_manager.go:414] "containerMap: removing container" podUID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" containerName="ta-container"
Oct 30 11:06:02.622231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.622169    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" containerName="ta-container"
Oct 30 11:06:02.622320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.622261    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e4c845a-6b16-45aa-bcfd-57dd8573d385" containerName="ta-container"
Oct 30 11:06:02.626665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.626644    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.643461 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.643438    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:02.698225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.698158    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swn4b\" (UniqueName: \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.698330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.698223    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.698330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.698308    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.798864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.798841    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.798967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.798883    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.798967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.798933    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swn4b\" (UniqueName: \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.799539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.799517    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.801388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.801356    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.823360 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.823328    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swn4b\" (UniqueName: \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\") pod \"data-science-collector-targetallocator-748cfdddf6-vhnb5\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:02.936983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:02.936964    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:03.239353 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.239259    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:03.242024 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:03.241991    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod603f2988_99cc_4198_abec_f19dff586a64.slice/crio-a3ddaf7b5e6e7aa9dc076bec37ca1879e2e5468989e13b2c3d12eea0fda32933 WatchSource:0}: Error finding container a3ddaf7b5e6e7aa9dc076bec37ca1879e2e5468989e13b2c3d12eea0fda32933: Status 404 returned error can't find the container with id a3ddaf7b5e6e7aa9dc076bec37ca1879e2e5468989e13b2c3d12eea0fda32933
Oct 30 11:06:03.244193 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.244159    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:06:03.244288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.244217    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:06:03.728421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.728389    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" event={"ID":"603f2988-99cc-4198-abec-f19dff586a64","Type":"ContainerStarted","Data":"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"}
Oct 30 11:06:03.728856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.728430    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" event={"ID":"603f2988-99cc-4198-abec-f19dff586a64","Type":"ContainerStarted","Data":"a3ddaf7b5e6e7aa9dc076bec37ca1879e2e5468989e13b2c3d12eea0fda32933"}
Oct 30 11:06:03.728856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.728545    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:03.730074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.730054    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:03.772175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.772133    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" podStartSLOduration=1.772121828 podStartE2EDuration="1.772121828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:06:03.77174738 +0000 UTC m=+1260.117339235" watchObservedRunningTime="2026-10-30 11:06:03.772121828 +0000 UTC m=+1260.117713682"
Oct 30 11:06:03.844654 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.844630    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:06:03.844781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:03.844762    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" podUID="2b7ea54d-8f79-461c-a21c-92e868750586" containerName="ta-container" containerID="cri-o://ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91" gracePeriod=30
Oct 30 11:06:04.082068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.082045    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:06:04.114669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.114645    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\" (UniqueName: \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\") pod \"2b7ea54d-8f79-461c-a21c-92e868750586\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") "
Oct 30 11:06:04.114768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.114722    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\") pod \"2b7ea54d-8f79-461c-a21c-92e868750586\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") "
Oct 30 11:06:04.114768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.114758    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\") pod \"2b7ea54d-8f79-461c-a21c-92e868750586\" (UID: \"2b7ea54d-8f79-461c-a21c-92e868750586\") "
Oct 30 11:06:04.115163 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.115141    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal" pod "2b7ea54d-8f79-461c-a21c-92e868750586" (UID: "2b7ea54d-8f79-461c-a21c-92e868750586"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:06:04.116596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.116568    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx" pod "2b7ea54d-8f79-461c-a21c-92e868750586" (UID: "2b7ea54d-8f79-461c-a21c-92e868750586"). InnerVolumeSpecName "kube-api-access-qdkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:06:04.116758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.116736    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert" pod "2b7ea54d-8f79-461c-a21c-92e868750586" (UID: "2b7ea54d-8f79-461c-a21c-92e868750586"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:06:04.215637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.215610    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b7ea54d-8f79-461c-a21c-92e868750586-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.215637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.215634    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b7ea54d-8f79-461c-a21c-92e868750586-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.215637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.215644    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdkhx\" (UniqueName: \"kubernetes.io/projected/2b7ea54d-8f79-461c-a21c-92e868750586-kube-api-access-qdkhx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.733539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.733505    4488 generic.go:356] "Generic (PLEG): container finished" podID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" containerID="cf9da08e65e78f57781ce43e6767300deeac16d5d6c86b805fa4a6ff196d0d8c" exitCode=0
Oct 30 11:06:04.733899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.733573    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bff3ced6-2502-4af1-9c91-48ff6b046cb4","Type":"ContainerDied","Data":"cf9da08e65e78f57781ce43e6767300deeac16d5d6c86b805fa4a6ff196d0d8c"}
Oct 30 11:06:04.734989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.734967    4488 generic.go:356] "Generic (PLEG): container finished" podID="2b7ea54d-8f79-461c-a21c-92e868750586" containerID="ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91" exitCode=0
Oct 30 11:06:04.735085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.735015    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"
Oct 30 11:06:04.735085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.735053    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" event={"ID":"2b7ea54d-8f79-461c-a21c-92e868750586","Type":"ContainerDied","Data":"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"}
Oct 30 11:06:04.735147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.735097    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w" event={"ID":"2b7ea54d-8f79-461c-a21c-92e868750586","Type":"ContainerDied","Data":"fbe5b9fc81f43b1f480f0a56fb1d59c020938919c7267d93df2db149dacbca0e"}
Oct 30 11:06:04.735147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.735124    4488 scope.go:122] "RemoveContainer" containerID="ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"
Oct 30 11:06:04.743232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.743213    4488 scope.go:122] "RemoveContainer" containerID="ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"
Oct 30 11:06:04.743632 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:06:04.743608    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91\": container with ID starting with ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91 not found: ID does not exist" containerID="ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"
Oct 30 11:06:04.743747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.743644    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91"} err="failed to get container status \"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91\": rpc error: code = NotFound desc = could not find container \"ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91\": container with ID starting with ddb75803b97b9d58e598098e9f366b1257293ff090ea70911357155c67a41c91 not found: ID does not exist"
Oct 30 11:06:04.754980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.754962    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:06:04.793942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.793898    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:06:04.799220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.799201    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5cc6858979-rc54w"]
Oct 30 11:06:04.820116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.820094    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\") pod \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") "
Oct 30 11:06:04.820189 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.820135    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\" (UniqueName: \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\") pod \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") "
Oct 30 11:06:04.820189 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.820160    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\") pod \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") "
Oct 30 11:06:04.820287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.820207    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\") pod \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") "
Oct 30 11:06:04.820287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.820228    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\") pod \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\" (UID: \"bff3ced6-2502-4af1-9c91-48ff6b046cb4\") "
Oct 30 11:06:04.821226 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.821164    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal" pod "bff3ced6-2502-4af1-9c91-48ff6b046cb4" (UID: "bff3ced6-2502-4af1-9c91-48ff6b046cb4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:06:04.822391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.822365    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert" pod "bff3ced6-2502-4af1-9c91-48ff6b046cb4" (UID: "bff3ced6-2502-4af1-9c91-48ff6b046cb4"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:06:04.822489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.822365    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7" pod "bff3ced6-2502-4af1-9c91-48ff6b046cb4" (UID: "bff3ced6-2502-4af1-9c91-48ff6b046cb4"). InnerVolumeSpecName "kube-api-access-nnsg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:06:04.822556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.822475    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs" pod "bff3ced6-2502-4af1-9c91-48ff6b046cb4" (UID: "bff3ced6-2502-4af1-9c91-48ff6b046cb4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:06:04.823057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.823037    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs" pod "bff3ced6-2502-4af1-9c91-48ff6b046cb4" (UID: "bff3ced6-2502-4af1-9c91-48ff6b046cb4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:06:04.921648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.921625    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnsg7\" (UniqueName: \"kubernetes.io/projected/bff3ced6-2502-4af1-9c91-48ff6b046cb4-kube-api-access-nnsg7\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.921648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.921647    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.921777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.921656    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.921777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.921664    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bff3ced6-2502-4af1-9c91-48ff6b046cb4-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:04.921777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:04.921674    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bff3ced6-2502-4af1-9c91-48ff6b046cb4-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:05.228307 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228275    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:05.228633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228618    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" containerName="otc-container"
Oct 30 11:06:05.228686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228634    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" containerName="otc-container"
Oct 30 11:06:05.228686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228671    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2b7ea54d-8f79-461c-a21c-92e868750586" containerName="ta-container"
Oct 30 11:06:05.228686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228677    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b7ea54d-8f79-461c-a21c-92e868750586" containerName="ta-container"
Oct 30 11:06:05.228786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228725    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b7ea54d-8f79-461c-a21c-92e868750586" containerName="ta-container"
Oct 30 11:06:05.228786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.228739    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" containerName="otc-container"
Oct 30 11:06:05.231709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.231693    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.247244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.247221    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:05.250901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.250882    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"odh-observability-metrics-ca\""
Oct 30 11:06:05.324683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.324655    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmbm\" (UniqueName: \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.324765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.324690    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.425402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.425380    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmbm\" (UniqueName: \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.425460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.425411    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.425953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.425938    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.450283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.450256    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmbm\" (UniqueName: \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\") pod \"operator-metrics-auth-probe\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.542946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.542895    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:05.741137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.741109    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bff3ced6-2502-4af1-9c91-48ff6b046cb4","Type":"ContainerDied","Data":"ce3997d406fe031cd53bac1b1aab940710ddf1e0117719a711545f60f31c10c9"}
Oct 30 11:06:05.741137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.741134    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:06:05.741592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.741167    4488 scope.go:122] "RemoveContainer" containerID="cf9da08e65e78f57781ce43e6767300deeac16d5d6c86b805fa4a6ff196d0d8c"
Oct 30 11:06:05.796530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.796474    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:06:05.802782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.802761    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b7ea54d-8f79-461c-a21c-92e868750586" path="/var/lib/kubelet/pods/2b7ea54d-8f79-461c-a21c-92e868750586/volumes"
Oct 30 11:06:05.810403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.810380    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:06:05.839622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:05.839598    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:05.842851 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:05.842832    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cb0f1d0_1712_40f5_9931_319b6c3a95cd.slice/crio-48a984f5f85cecc51d1b1ef03dc15a19cfc78ad8319de9fa60b2f5f707c4fd53 WatchSource:0}: Error finding container 48a984f5f85cecc51d1b1ef03dc15a19cfc78ad8319de9fa60b2f5f707c4fd53: Status 404 returned error can't find the container with id 48a984f5f85cecc51d1b1ef03dc15a19cfc78ad8319de9fa60b2f5f707c4fd53
Oct 30 11:06:06.747327 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:06.747282    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"5cb0f1d0-1712-40f5-9931-319b6c3a95cd","Type":"ContainerStarted","Data":"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"}
Oct 30 11:06:06.747327 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:06.747321    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"5cb0f1d0-1712-40f5-9931-319b6c3a95cd","Type":"ContainerStarted","Data":"48a984f5f85cecc51d1b1ef03dc15a19cfc78ad8319de9fa60b2f5f707c4fd53"}
Oct 30 11:06:06.789636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:06.789589    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podStartSLOduration=1.789575556 podStartE2EDuration="1.789575556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:06:06.789047128 +0000 UTC m=+1263.134638988" watchObservedRunningTime="2026-10-30 11:06:06.789575556 +0000 UTC m=+1263.135167423"
Oct 30 11:06:07.806333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:07.806298    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bff3ced6-2502-4af1-9c91-48ff6b046cb4" path="/var/lib/kubelet/pods/bff3ced6-2502-4af1-9c91-48ff6b046cb4/volumes"
Oct 30 11:06:11.131895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:11.131867    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:11.132304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:11.132031    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podUID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" containerName="curl" containerID="cri-o://716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43" gracePeriod=30
Oct 30 11:06:17.690933 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:17.690896    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"]
Oct 30 11:06:17.694552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:17.694535    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"
Oct 30 11:06:17.705020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:17.705003    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"
Oct 30 11:06:17.709430 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:17.709407    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"]
Oct 30 11:06:18.004172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:18.004151    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"]
Oct 30 11:06:18.006299 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:18.006271    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62b10050_b140_4dfe_a2b5_e81a07533094.slice/crio-67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552 WatchSource:0}: Error finding container 67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552: Status 404 returned error can't find the container with id 67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552
Oct 30 11:06:18.008283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:18.008265    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 11:06:18.793488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:18.793456    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea" event={"ID":"62b10050-b140-4dfe-a2b5-e81a07533094","Type":"ContainerStarted","Data":"67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552"}
Oct 30 11:06:21.806947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:21.806917    4488 generic.go:356] "Generic (PLEG): container finished" podID="62b10050-b140-4dfe-a2b5-e81a07533094" containerID="65e2639e5361807fcaabfd11f3bf1bd017528e1a9054114a404ba6d234144762" exitCode=0
Oct 30 11:06:21.807306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:21.806968    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea" event={"ID":"62b10050-b140-4dfe-a2b5-e81a07533094","Type":"ContainerDied","Data":"65e2639e5361807fcaabfd11f3bf1bd017528e1a9054114a404ba6d234144762"}
Oct 30 11:06:22.936361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:22.936317    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"
Oct 30 11:06:23.814489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:23.814461    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea" event={"ID":"62b10050-b140-4dfe-a2b5-e81a07533094","Type":"ContainerDied","Data":"67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552"}
Oct 30 11:06:23.814649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:23.814494    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67ca59c7f4303741121edb85ea8cc31151a51c6d70a09381584b9e39cbc1e552"
Oct 30 11:06:23.814649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:23.814495    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"
Oct 30 11:06:31.477674 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:06:31.477626    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:06:38.171955 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.171918    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"]
Oct 30 11:06:38.172455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.172377    4488 cpu_manager.go:414] "containerMap: removing container" podUID="62b10050-b140-4dfe-a2b5-e81a07533094" containerName="curl"
Oct 30 11:06:38.172455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.172397    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62b10050-b140-4dfe-a2b5-e81a07533094" containerName="curl"
Oct 30 11:06:38.172641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.172493    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="62b10050-b140-4dfe-a2b5-e81a07533094" containerName="curl"
Oct 30 11:06:38.176778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.176755    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"
Oct 30 11:06:38.187110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.187091    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"
Oct 30 11:06:38.190718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.190692    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"]
Oct 30 11:06:38.480927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.480901    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"]
Oct 30 11:06:38.483554 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:38.483519    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc215b220_058e_4489_b623_ecdbeff2d977.slice/crio-9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74 WatchSource:0}: Error finding container 9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74: Status 404 returned error can't find the container with id 9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74
Oct 30 11:06:38.876457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.876382    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88" event={"ID":"c215b220-058e-4489-b623-ecdbeff2d977","Type":"ContainerStarted","Data":"470d20a960645b0335fab46115c8f9b340c4e82e35fc0cdbff28d0d336e1d3f7"}
Oct 30 11:06:38.876457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.876420    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88" event={"ID":"c215b220-058e-4489-b623-ecdbeff2d977","Type":"ContainerStarted","Data":"9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74"}
Oct 30 11:06:38.918672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:38.918622    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88" podStartSLOduration=0.918611188 podStartE2EDuration="918.611188ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:06:38.917676575 +0000 UTC m=+1295.263268429" watchObservedRunningTime="2026-10-30 11:06:38.918611188 +0000 UTC m=+1295.264203032"
Oct 30 11:06:40.236610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.236579    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:06:40.239791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.239774    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.271269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.271242    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:06:40.289494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.289470    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.289607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.289509    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2zx\" (UniqueName: \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.289607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.289532    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.389856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.389832    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.389962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.389870    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2zx\" (UniqueName: \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.389962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.389891    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.390556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.390532    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.392203 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.392179    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.414464 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.414440    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2zx\" (UniqueName: \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\") pod \"data-science-collector-targetallocator-5dff6955b5-c22mv\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.550607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.550549    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:40.849078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.849053    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:06:40.851638 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:40.851601    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d16585d_436d_42fb_a35d_e5354932e2e7.slice/crio-286e143968fef2b4f6f4103c31f31bea6bb1a3e88c875a90dd2f278e3fb15597 WatchSource:0}: Error finding container 286e143968fef2b4f6f4103c31f31bea6bb1a3e88c875a90dd2f278e3fb15597: Status 404 returned error can't find the container with id 286e143968fef2b4f6f4103c31f31bea6bb1a3e88c875a90dd2f278e3fb15597
Oct 30 11:06:40.853937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.853905    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:06:40.854016 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.853969    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:06:40.884504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:40.884483    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" event={"ID":"8d16585d-436d-42fb-a35d-e5354932e2e7","Type":"ContainerStarted","Data":"286e143968fef2b4f6f4103c31f31bea6bb1a3e88c875a90dd2f278e3fb15597"}
Oct 30 11:06:41.258060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.258037    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:41.295620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.295596    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\" (UniqueName: \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\") pod \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") "
Oct 30 11:06:41.295743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.295634    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\" (UniqueName: \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\") pod \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\" (UID: \"5cb0f1d0-1712-40f5-9931-319b6c3a95cd\") "
Oct 30 11:06:41.296010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.295989    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca" pod "5cb0f1d0-1712-40f5-9931-319b6c3a95cd" (UID: "5cb0f1d0-1712-40f5-9931-319b6c3a95cd"). InnerVolumeSpecName "metrics-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:06:41.297627 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.297607    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm" pod "5cb0f1d0-1712-40f5-9931-319b6c3a95cd" (UID: "5cb0f1d0-1712-40f5-9931-319b6c3a95cd"). InnerVolumeSpecName "kube-api-access-mgmbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:06:41.397019 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.396960    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgmbm\" (UniqueName: \"kubernetes.io/projected/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-kube-api-access-mgmbm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:41.397019 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.396986    4488 reconciler_common.go:299] "Volume detached for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/5cb0f1d0-1712-40f5-9931-319b6c3a95cd-metrics-ca\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:41.890393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.890362    4488 generic.go:356] "Generic (PLEG): container finished" podID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" containerID="716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43" exitCode=137
Oct 30 11:06:41.890537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.890407    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 11:06:41.890537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.890441    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"5cb0f1d0-1712-40f5-9931-319b6c3a95cd","Type":"ContainerDied","Data":"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"}
Oct 30 11:06:41.890537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.890473    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"5cb0f1d0-1712-40f5-9931-319b6c3a95cd","Type":"ContainerDied","Data":"48a984f5f85cecc51d1b1ef03dc15a19cfc78ad8319de9fa60b2f5f707c4fd53"}
Oct 30 11:06:41.890537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.890489    4488 scope.go:122] "RemoveContainer" containerID="716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"
Oct 30 11:06:41.892381 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.892314    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" event={"ID":"8d16585d-436d-42fb-a35d-e5354932e2e7","Type":"ContainerStarted","Data":"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"}
Oct 30 11:06:41.892590 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.892516    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:41.894160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.894138    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:06:41.898808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.898792    4488 scope.go:122] "RemoveContainer" containerID="716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"
Oct 30 11:06:41.899053 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:06:41.899035    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43\": container with ID starting with 716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43 not found: ID does not exist" containerID="716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"
Oct 30 11:06:41.899104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.899061    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43"} err="failed to get container status \"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43\": rpc error: code = NotFound desc = could not find container \"716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43\": container with ID starting with 716c57b606ebe9830465d6b3cef2c807145f84cbf51a5b93b1a2d8a0feca9f43 not found: ID does not exist"
Oct 30 11:06:41.951459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.951419    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" podStartSLOduration=1.951408352 podStartE2EDuration="1.951408352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:06:41.95125772 +0000 UTC m=+1298.296849577" watchObservedRunningTime="2026-10-30 11:06:41.951408352 +0000 UTC m=+1298.297000205"
Oct 30 11:06:41.980648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.980626    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:41.980806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.980787    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" podUID="603f2988-99cc-4198-abec-f19dff586a64" containerName="ta-container" containerID="cri-o://b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc" gracePeriod=30
Oct 30 11:06:41.992746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.992723    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:41.997048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:41.997027    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 11:06:42.219114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.219092    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:42.302613 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.302584    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\") pod \"603f2988-99cc-4198-abec-f19dff586a64\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") "
Oct 30 11:06:42.303004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.302624    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\" (UniqueName: \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\") pod \"603f2988-99cc-4198-abec-f19dff586a64\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") "
Oct 30 11:06:42.303004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.302653    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\" (UniqueName: \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\") pod \"603f2988-99cc-4198-abec-f19dff586a64\" (UID: \"603f2988-99cc-4198-abec-f19dff586a64\") "
Oct 30 11:06:42.303004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.302900    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal" pod "603f2988-99cc-4198-abec-f19dff586a64" (UID: "603f2988-99cc-4198-abec-f19dff586a64"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:06:42.304633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.304603    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b" pod "603f2988-99cc-4198-abec-f19dff586a64" (UID: "603f2988-99cc-4198-abec-f19dff586a64"). InnerVolumeSpecName "kube-api-access-swn4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:06:42.304713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.304659    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert" pod "603f2988-99cc-4198-abec-f19dff586a64" (UID: "603f2988-99cc-4198-abec-f19dff586a64"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:06:42.403220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.403172    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/603f2988-99cc-4198-abec-f19dff586a64-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:42.403220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.403191    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swn4b\" (UniqueName: \"kubernetes.io/projected/603f2988-99cc-4198-abec-f19dff586a64-kube-api-access-swn4b\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:42.403220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.403202    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/603f2988-99cc-4198-abec-f19dff586a64-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:06:42.897007 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.896974    4488 generic.go:356] "Generic (PLEG): container finished" podID="603f2988-99cc-4198-abec-f19dff586a64" containerID="b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc" exitCode=0
Oct 30 11:06:42.897147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.897014    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"
Oct 30 11:06:42.897147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.897049    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" event={"ID":"603f2988-99cc-4198-abec-f19dff586a64","Type":"ContainerDied","Data":"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"}
Oct 30 11:06:42.897147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.897083    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5" event={"ID":"603f2988-99cc-4198-abec-f19dff586a64","Type":"ContainerDied","Data":"a3ddaf7b5e6e7aa9dc076bec37ca1879e2e5468989e13b2c3d12eea0fda32933"}
Oct 30 11:06:42.897147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.897101    4488 scope.go:122] "RemoveContainer" containerID="b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"
Oct 30 11:06:42.905466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.905446    4488 scope.go:122] "RemoveContainer" containerID="b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"
Oct 30 11:06:42.905744 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:06:42.905723    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc\": container with ID starting with b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc not found: ID does not exist" containerID="b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"
Oct 30 11:06:42.905830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.905748    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc"} err="failed to get container status \"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc\": rpc error: code = NotFound desc = could not find container \"b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc\": container with ID starting with b4a6e3f56b99db015c282df6758552ac2128839e56dec4e3ec97bb54726690bc not found: ID does not exist"
Oct 30 11:06:42.952719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.952688    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:42.966680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:42.966651    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-vhnb5"]
Oct 30 11:06:43.803266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:43.803230    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" path="/var/lib/kubelet/pods/5cb0f1d0-1712-40f5-9931-319b6c3a95cd/volumes"
Oct 30 11:06:43.803665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:43.803610    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="603f2988-99cc-4198-abec-f19dff586a64" path="/var/lib/kubelet/pods/603f2988-99cc-4198-abec-f19dff586a64/volumes"
Oct 30 11:06:48.924439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:48.924406    4488 generic.go:356] "Generic (PLEG): container finished" podID="c215b220-058e-4489-b623-ecdbeff2d977" containerID="470d20a960645b0335fab46115c8f9b340c4e82e35fc0cdbff28d0d336e1d3f7" exitCode=0
Oct 30 11:06:48.924860 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:48.924474    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88" event={"ID":"c215b220-058e-4489-b623-ecdbeff2d977","Type":"ContainerDied","Data":"470d20a960645b0335fab46115c8f9b340c4e82e35fc0cdbff28d0d336e1d3f7"}
Oct 30 11:06:50.051548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.051525    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"
Oct 30 11:06:50.383121 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383048    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"]
Oct 30 11:06:50.383337 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383326    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c215b220-058e-4489-b623-ecdbeff2d977" containerName="curl"
Oct 30 11:06:50.383400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383350    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c215b220-058e-4489-b623-ecdbeff2d977" containerName="curl"
Oct 30 11:06:50.383400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383367    4488 cpu_manager.go:414] "containerMap: removing container" podUID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" containerName="curl"
Oct 30 11:06:50.383400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383372    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" containerName="curl"
Oct 30 11:06:50.383400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383384    4488 cpu_manager.go:414] "containerMap: removing container" podUID="603f2988-99cc-4198-abec-f19dff586a64" containerName="ta-container"
Oct 30 11:06:50.383400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383390    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="603f2988-99cc-4198-abec-f19dff586a64" containerName="ta-container"
Oct 30 11:06:50.383550 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383442    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c215b220-058e-4489-b623-ecdbeff2d977" containerName="curl"
Oct 30 11:06:50.383550 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383450    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cb0f1d0-1712-40f5-9931-319b6c3a95cd" containerName="curl"
Oct 30 11:06:50.383550 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.383456    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="603f2988-99cc-4198-abec-f19dff586a64" containerName="ta-container"
Oct 30 11:06:50.386413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.386397    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"
Oct 30 11:06:50.397038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.397022    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"
Oct 30 11:06:50.404458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.404430    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"]
Oct 30 11:06:50.693373 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.693240    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"]
Oct 30 11:06:50.695939 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:06:50.695914    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54338821_30da_4c4e_b0ca_ae7d0247433f.slice/crio-7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748 WatchSource:0}: Error finding container 7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748: Status 404 returned error can't find the container with id 7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748
Oct 30 11:06:50.934265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.934230    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496" event={"ID":"54338821-30da-4c4e-b0ca-ae7d0247433f","Type":"ContainerStarted","Data":"1f4816e8dbde240a0923d9ad2bcfef7b651f6ebf25ea9aebba09878109844ae7"}
Oct 30 11:06:50.934265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.934269    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496" event={"ID":"54338821-30da-4c4e-b0ca-ae7d0247433f","Type":"ContainerStarted","Data":"7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748"}
Oct 30 11:06:50.935457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.935430    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88" event={"ID":"c215b220-058e-4489-b623-ecdbeff2d977","Type":"ContainerDied","Data":"9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74"}
Oct 30 11:06:50.935548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.935465    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9447bed6bdd2eaeeeeb919fc6872abc682d0186c00ef43864074f9328f943e74"
Oct 30 11:06:50.935548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.935505    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"
Oct 30 11:06:50.977501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:06:50.977425    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496" podStartSLOduration=0.97741089 podStartE2EDuration="977.41089ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:06:50.9768857 +0000 UTC m=+1307.322477553" watchObservedRunningTime="2026-10-30 11:06:50.97741089 +0000 UTC m=+1307.323002737"
Oct 30 11:07:00.977521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:00.977487    4488 generic.go:356] "Generic (PLEG): container finished" podID="54338821-30da-4c4e-b0ca-ae7d0247433f" containerID="1f4816e8dbde240a0923d9ad2bcfef7b651f6ebf25ea9aebba09878109844ae7" exitCode=0
Oct 30 11:07:00.977850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:00.977557    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496" event={"ID":"54338821-30da-4c4e-b0ca-ae7d0247433f","Type":"ContainerDied","Data":"1f4816e8dbde240a0923d9ad2bcfef7b651f6ebf25ea9aebba09878109844ae7"}
Oct 30 11:07:01.478317 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:07:01.478280    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:07:02.102957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.102933    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"
Oct 30 11:07:02.590363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.590324    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"]
Oct 30 11:07:02.590638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.590625    4488 cpu_manager.go:414] "containerMap: removing container" podUID="54338821-30da-4c4e-b0ca-ae7d0247433f" containerName="curl"
Oct 30 11:07:02.590685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.590639    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54338821-30da-4c4e-b0ca-ae7d0247433f" containerName="curl"
Oct 30 11:07:02.590720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.590694    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="54338821-30da-4c4e-b0ca-ae7d0247433f" containerName="curl"
Oct 30 11:07:02.593428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.593412    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"
Oct 30 11:07:02.603591 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.603571    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"
Oct 30 11:07:02.609519 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.609500    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"]
Oct 30 11:07:02.899403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.899273    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"]
Oct 30 11:07:02.901983 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:07:02.901954    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda249d4c2_32b3_4311_b2cc_d4d9786c629a.slice/crio-187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407 WatchSource:0}: Error finding container 187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407: Status 404 returned error can't find the container with id 187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407
Oct 30 11:07:02.986239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.986210    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"
Oct 30 11:07:02.986381 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.986212    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496" event={"ID":"54338821-30da-4c4e-b0ca-ae7d0247433f","Type":"ContainerDied","Data":"7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748"}
Oct 30 11:07:02.986381 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.986313    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bfe95b67439d7329c7c5af9196620988c1fecd8971065b52ccb78ace4538748"
Oct 30 11:07:02.987831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.987808    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b" event={"ID":"a249d4c2-32b3-4311-b2cc-d4d9786c629a","Type":"ContainerStarted","Data":"58bef7fc2595435db75f92fdaacf4471dc114ddaaeb0f30e5efc45c5273a13d7"}
Oct 30 11:07:02.987948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:02.987843    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b" event={"ID":"a249d4c2-32b3-4311-b2cc-d4d9786c629a","Type":"ContainerStarted","Data":"187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407"}
Oct 30 11:07:03.029770 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:03.029700    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b" podStartSLOduration=1.029690302 podStartE2EDuration="1.029690302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:07:03.028754401 +0000 UTC m=+1319.374346258" watchObservedRunningTime="2026-10-30 11:07:03.029690302 +0000 UTC m=+1319.375282156"
Oct 30 11:07:13.027803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:13.027765    4488 generic.go:356] "Generic (PLEG): container finished" podID="a249d4c2-32b3-4311-b2cc-d4d9786c629a" containerID="58bef7fc2595435db75f92fdaacf4471dc114ddaaeb0f30e5efc45c5273a13d7" exitCode=0
Oct 30 11:07:13.028125 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:13.027839    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b" event={"ID":"a249d4c2-32b3-4311-b2cc-d4d9786c629a","Type":"ContainerDied","Data":"58bef7fc2595435db75f92fdaacf4471dc114ddaaeb0f30e5efc45c5273a13d7"}
Oct 30 11:07:14.154246 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.154215    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"
Oct 30 11:07:14.802356 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.802315    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"]
Oct 30 11:07:14.802633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.802620    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a249d4c2-32b3-4311-b2cc-d4d9786c629a" containerName="curl"
Oct 30 11:07:14.802677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.802635    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a249d4c2-32b3-4311-b2cc-d4d9786c629a" containerName="curl"
Oct 30 11:07:14.802712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.802686    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a249d4c2-32b3-4311-b2cc-d4d9786c629a" containerName="curl"
Oct 30 11:07:14.805514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.805500    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"
Oct 30 11:07:14.815497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.815478    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"
Oct 30 11:07:14.821264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:14.821238    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"]
Oct 30 11:07:15.036457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:15.036423    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b" event={"ID":"a249d4c2-32b3-4311-b2cc-d4d9786c629a","Type":"ContainerDied","Data":"187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407"}
Oct 30 11:07:15.036457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:15.036458    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"
Oct 30 11:07:15.036648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:15.036462    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="187b4003c57cb8847227fb091d58ba9c3bdec8ad669f98ec888ac6be6687e407"
Oct 30 11:07:15.113472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:15.113409    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"]
Oct 30 11:07:15.116409 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:07:15.116385    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73d7c8e6_64f6_448c_bcea_ab948cc4c540.slice/crio-56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec WatchSource:0}: Error finding container 56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec: Status 404 returned error can't find the container with id 56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec
Oct 30 11:07:16.041635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:16.041605    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8" event={"ID":"73d7c8e6-64f6-448c-bcea-ab948cc4c540","Type":"ContainerStarted","Data":"ace77f9e206969e6e64cc2838d3d924cd4305eb109176a04907bed10981a7410"}
Oct 30 11:07:16.042051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:16.041641    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8" event={"ID":"73d7c8e6-64f6-448c-bcea-ab948cc4c540","Type":"ContainerStarted","Data":"56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec"}
Oct 30 11:07:16.083262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:16.083220    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8" podStartSLOduration=2.083205812 podStartE2EDuration="2.083205812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:07:16.082959207 +0000 UTC m=+1332.428551064" watchObservedRunningTime="2026-10-30 11:07:16.083205812 +0000 UTC m=+1332.428797667"
Oct 30 11:07:26.078896 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:26.078862    4488 generic.go:356] "Generic (PLEG): container finished" podID="73d7c8e6-64f6-448c-bcea-ab948cc4c540" containerID="ace77f9e206969e6e64cc2838d3d924cd4305eb109176a04907bed10981a7410" exitCode=0
Oct 30 11:07:26.079278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:26.078921    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8" event={"ID":"73d7c8e6-64f6-448c-bcea-ab948cc4c540","Type":"ContainerDied","Data":"ace77f9e206969e6e64cc2838d3d924cd4305eb109176a04907bed10981a7410"}
Oct 30 11:07:27.210050 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:27.210028    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"
Oct 30 11:07:28.088122 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:28.088059    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"
Oct 30 11:07:28.088272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:28.088049    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8" event={"ID":"73d7c8e6-64f6-448c-bcea-ab948cc4c540","Type":"ContainerDied","Data":"56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec"}
Oct 30 11:07:28.088272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:28.088191    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56bd713d118da50b3598b146c8aa55b84e98884d7d0041e677863c33a668cbec"
Oct 30 11:07:29.027579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.027540    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"]
Oct 30 11:07:29.028055 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.027959    4488 cpu_manager.go:414] "containerMap: removing container" podUID="73d7c8e6-64f6-448c-bcea-ab948cc4c540" containerName="curl"
Oct 30 11:07:29.028055 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.027978    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73d7c8e6-64f6-448c-bcea-ab948cc4c540" containerName="curl"
Oct 30 11:07:29.028172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.028092    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="73d7c8e6-64f6-448c-bcea-ab948cc4c540" containerName="curl"
Oct 30 11:07:29.030974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.030953    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"
Oct 30 11:07:29.041264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.041245    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"
Oct 30 11:07:29.047074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.047054    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"]
Oct 30 11:07:29.337015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:29.336943    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"]
Oct 30 11:07:29.339940 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:07:29.339915    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod062012c8_919d_43ed_98e7_77c58c9fd94c.slice/crio-a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731 WatchSource:0}: Error finding container a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731: Status 404 returned error can't find the container with id a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731
Oct 30 11:07:30.105012 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:30.104977    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09" event={"ID":"062012c8-919d-43ed-98e7-77c58c9fd94c","Type":"ContainerStarted","Data":"809c6c4b3c53c1476a6759bf8829b0b3b431c3203a551e2ef7c698bd0fdb97b6"}
Oct 30 11:07:30.105437 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:30.105021    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09" event={"ID":"062012c8-919d-43ed-98e7-77c58c9fd94c","Type":"ContainerStarted","Data":"a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731"}
Oct 30 11:07:30.146720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:30.146680    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09" podStartSLOduration=1.146666746 podStartE2EDuration="1.146666746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:07:30.146026445 +0000 UTC m=+1346.491618299" watchObservedRunningTime="2026-10-30 11:07:30.146666746 +0000 UTC m=+1346.492258599"
Oct 30 11:07:31.478116 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:07:31.478079    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:07:40.148253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:40.148222    4488 generic.go:356] "Generic (PLEG): container finished" podID="062012c8-919d-43ed-98e7-77c58c9fd94c" containerID="809c6c4b3c53c1476a6759bf8829b0b3b431c3203a551e2ef7c698bd0fdb97b6" exitCode=0
Oct 30 11:07:40.148677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:40.148298    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09" event={"ID":"062012c8-919d-43ed-98e7-77c58c9fd94c","Type":"ContainerDied","Data":"809c6c4b3c53c1476a6759bf8829b0b3b431c3203a551e2ef7c698bd0fdb97b6"}
Oct 30 11:07:41.283125 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:41.283103    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"
Oct 30 11:07:42.157398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:42.157310    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"
Oct 30 11:07:42.157398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:42.157333    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09" event={"ID":"062012c8-919d-43ed-98e7-77c58c9fd94c","Type":"ContainerDied","Data":"a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731"}
Oct 30 11:07:42.157398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:42.157395    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a72d27b2eb16e86c28a41ed565c3d996e8eac12d64a3883264d5601061b3d731"
Oct 30 11:07:43.250562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.250533    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"]
Oct 30 11:07:43.250943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.250812    4488 cpu_manager.go:414] "containerMap: removing container" podUID="062012c8-919d-43ed-98e7-77c58c9fd94c" containerName="curl"
Oct 30 11:07:43.250943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.250823    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="062012c8-919d-43ed-98e7-77c58c9fd94c" containerName="curl"
Oct 30 11:07:43.250943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.250876    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="062012c8-919d-43ed-98e7-77c58c9fd94c" containerName="curl"
Oct 30 11:07:43.253638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.253622    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"
Oct 30 11:07:43.263747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.263729    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"
Oct 30 11:07:43.267454 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.267432    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"]
Oct 30 11:07:43.562458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:43.562379    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"]
Oct 30 11:07:43.565927 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:07:43.565895    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6ad01e9_0b2f_41aa_8fc8_e62733308809.slice/crio-20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec WatchSource:0}: Error finding container 20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec: Status 404 returned error can't find the container with id 20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec
Oct 30 11:07:44.166427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:44.166388    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122" event={"ID":"b6ad01e9-0b2f-41aa-8fc8-e62733308809","Type":"ContainerStarted","Data":"fa648d957b58df9ffde7c7e68922db26b104bfb08aec02c929e72e0f8bd7db73"}
Oct 30 11:07:44.166427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:44.166429    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122" event={"ID":"b6ad01e9-0b2f-41aa-8fc8-e62733308809","Type":"ContainerStarted","Data":"20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec"}
Oct 30 11:07:44.213049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:44.213007    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122" podStartSLOduration=1.212995705 podStartE2EDuration="1.212995705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:07:44.212199347 +0000 UTC m=+1360.557791200" watchObservedRunningTime="2026-10-30 11:07:44.212995705 +0000 UTC m=+1360.558587559"
Oct 30 11:07:54.205683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:54.205644    4488 generic.go:356] "Generic (PLEG): container finished" podID="b6ad01e9-0b2f-41aa-8fc8-e62733308809" containerID="fa648d957b58df9ffde7c7e68922db26b104bfb08aec02c929e72e0f8bd7db73" exitCode=0
Oct 30 11:07:54.206099 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:54.205678    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122" event={"ID":"b6ad01e9-0b2f-41aa-8fc8-e62733308809","Type":"ContainerDied","Data":"fa648d957b58df9ffde7c7e68922db26b104bfb08aec02c929e72e0f8bd7db73"}
Oct 30 11:07:55.333046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:55.333023    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"
Oct 30 11:07:56.216154 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:56.216123    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122" event={"ID":"b6ad01e9-0b2f-41aa-8fc8-e62733308809","Type":"ContainerDied","Data":"20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec"}
Oct 30 11:07:56.216311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:56.216162    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"
Oct 30 11:07:56.216311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:56.216167    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20e4497c03e68efa6f9417beef8d3aec5c2878dd8198603f7004faa7b2db9fec"
Oct 30 11:07:57.478553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.478517    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"]
Oct 30 11:07:57.479025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.478954    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b6ad01e9-0b2f-41aa-8fc8-e62733308809" containerName="curl"
Oct 30 11:07:57.479025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.478973    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6ad01e9-0b2f-41aa-8fc8-e62733308809" containerName="curl"
Oct 30 11:07:57.479142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.479077    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6ad01e9-0b2f-41aa-8fc8-e62733308809" containerName="curl"
Oct 30 11:07:57.481902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.481880    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"
Oct 30 11:07:57.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.492060    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"
Oct 30 11:07:57.497822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.497801    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"]
Oct 30 11:07:57.792608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:57.792585    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"]
Oct 30 11:07:57.794225 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:07:57.794190    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076f7a47_7465_4160_a212_a2dc90088fc5.slice/crio-91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae WatchSource:0}: Error finding container 91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae: Status 404 returned error can't find the container with id 91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae
Oct 30 11:07:58.225720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:58.225685    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e" event={"ID":"076f7a47-7465-4160-a212-a2dc90088fc5","Type":"ContainerStarted","Data":"e070d1bf861a81f8eed7431c40a54b3e9166ee111ad2fcbb62435c265981cb90"}
Oct 30 11:07:58.225909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:58.225732    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e" event={"ID":"076f7a47-7465-4160-a212-a2dc90088fc5","Type":"ContainerStarted","Data":"91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae"}
Oct 30 11:07:58.267044 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:07:58.266999    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e" podStartSLOduration=1.266984857 podStartE2EDuration="1.266984857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:07:58.266204616 +0000 UTC m=+1374.611796471" watchObservedRunningTime="2026-10-30 11:07:58.266984857 +0000 UTC m=+1374.612576710"
Oct 30 11:08:01.478186 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:08:01.478155    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:08:08.266913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:08.266881    4488 generic.go:356] "Generic (PLEG): container finished" podID="076f7a47-7465-4160-a212-a2dc90088fc5" containerID="e070d1bf861a81f8eed7431c40a54b3e9166ee111ad2fcbb62435c265981cb90" exitCode=0
Oct 30 11:08:08.267290 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:08.266937    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e" event={"ID":"076f7a47-7465-4160-a212-a2dc90088fc5","Type":"ContainerDied","Data":"e070d1bf861a81f8eed7431c40a54b3e9166ee111ad2fcbb62435c265981cb90"}
Oct 30 11:08:09.391948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.391923    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"
Oct 30 11:08:09.688260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.688230    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"]
Oct 30 11:08:09.688594 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.688579    4488 cpu_manager.go:414] "containerMap: removing container" podUID="076f7a47-7465-4160-a212-a2dc90088fc5" containerName="curl"
Oct 30 11:08:09.688643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.688596    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="076f7a47-7465-4160-a212-a2dc90088fc5" containerName="curl"
Oct 30 11:08:09.688678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.688643    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="076f7a47-7465-4160-a212-a2dc90088fc5" containerName="curl"
Oct 30 11:08:09.691375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.691357    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"
Oct 30 11:08:09.701539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.701520    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"
Oct 30 11:08:09.708194 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.708171    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"]
Oct 30 11:08:09.994543 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:09.994519    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"]
Oct 30 11:08:09.996882 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:08:09.996857    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec03618b_c8d2_4ca1_a7da_0738fd3b970b.slice/crio-f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4 WatchSource:0}: Error finding container f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4: Status 404 returned error can't find the container with id f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4
Oct 30 11:08:10.276547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.276450    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025" event={"ID":"ec03618b-c8d2-4ca1-a7da-0738fd3b970b","Type":"ContainerStarted","Data":"53d6012cb66dc717d8faf8ed9466bd7be7914dca4cdd151f87b86aa40edb3b1f"}
Oct 30 11:08:10.276547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.276509    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025" event={"ID":"ec03618b-c8d2-4ca1-a7da-0738fd3b970b","Type":"ContainerStarted","Data":"f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4"}
Oct 30 11:08:10.277655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.277632    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e" event={"ID":"076f7a47-7465-4160-a212-a2dc90088fc5","Type":"ContainerDied","Data":"91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae"}
Oct 30 11:08:10.277655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.277643    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"
Oct 30 11:08:10.277655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.277658    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91dc28ee755691312bcc941beedfc4a3dcb48438e14f056c555a98361f0d85ae"
Oct 30 11:08:10.318631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:10.318582    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025" podStartSLOduration=1.318570653 podStartE2EDuration="1.318570653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:08:10.317392676 +0000 UTC m=+1386.662984532" watchObservedRunningTime="2026-10-30 11:08:10.318570653 +0000 UTC m=+1386.664162506"
Oct 30 11:08:20.318223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:20.318149    4488 generic.go:356] "Generic (PLEG): container finished" podID="ec03618b-c8d2-4ca1-a7da-0738fd3b970b" containerID="53d6012cb66dc717d8faf8ed9466bd7be7914dca4cdd151f87b86aa40edb3b1f" exitCode=0
Oct 30 11:08:20.318622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:20.318219    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025" event={"ID":"ec03618b-c8d2-4ca1-a7da-0738fd3b970b","Type":"ContainerDied","Data":"53d6012cb66dc717d8faf8ed9466bd7be7914dca4cdd151f87b86aa40edb3b1f"}
Oct 30 11:08:21.454119 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.454097    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"
Oct 30 11:08:21.899157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.899127    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"]
Oct 30 11:08:21.899486 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.899472    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ec03618b-c8d2-4ca1-a7da-0738fd3b970b" containerName="curl"
Oct 30 11:08:21.899532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.899488    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec03618b-c8d2-4ca1-a7da-0738fd3b970b" containerName="curl"
Oct 30 11:08:21.899567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.899551    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec03618b-c8d2-4ca1-a7da-0738fd3b970b" containerName="curl"
Oct 30 11:08:21.902555 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.902538    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"
Oct 30 11:08:21.912886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.912866    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"
Oct 30 11:08:21.918873 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:21.918855    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"]
Oct 30 11:08:22.208559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.208532    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"]
Oct 30 11:08:22.211677 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:08:22.211648    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4b21f8_ff6a_4d25_aa74_de55f4cf9957.slice/crio-71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81 WatchSource:0}: Error finding container 71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81: Status 404 returned error can't find the container with id 71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81
Oct 30 11:08:22.327530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.327508    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"
Oct 30 11:08:22.327669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.327552    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025" event={"ID":"ec03618b-c8d2-4ca1-a7da-0738fd3b970b","Type":"ContainerDied","Data":"f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4"}
Oct 30 11:08:22.327669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.327593    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1b637dd1e48ef9280ae341bf8e7ce3a0215ae7383636c2b4f709ce03733c3b4"
Oct 30 11:08:22.328942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.328917    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b" event={"ID":"5a4b21f8-ff6a-4d25-aa74-de55f4cf9957","Type":"ContainerStarted","Data":"1d01958c6f6471d4b2d8db5fa433af8d73cc5aee011bdbac252b3876e158cedd"}
Oct 30 11:08:22.329062 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.328949    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b" event={"ID":"5a4b21f8-ff6a-4d25-aa74-de55f4cf9957","Type":"ContainerStarted","Data":"71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81"}
Oct 30 11:08:22.371428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:22.371385    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b" podStartSLOduration=1.371373886 podStartE2EDuration="1.371373886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:08:22.370376759 +0000 UTC m=+1398.715968614" watchObservedRunningTime="2026-10-30 11:08:22.371373886 +0000 UTC m=+1398.716965762"
Oct 30 11:08:31.477430 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:08:31.477387    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:08:32.375923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:32.375887    4488 generic.go:356] "Generic (PLEG): container finished" podID="5a4b21f8-ff6a-4d25-aa74-de55f4cf9957" containerID="1d01958c6f6471d4b2d8db5fa433af8d73cc5aee011bdbac252b3876e158cedd" exitCode=0
Oct 30 11:08:32.376045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:32.375963    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b" event={"ID":"5a4b21f8-ff6a-4d25-aa74-de55f4cf9957","Type":"ContainerDied","Data":"1d01958c6f6471d4b2d8db5fa433af8d73cc5aee011bdbac252b3876e158cedd"}
Oct 30 11:08:33.504160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:33.504136    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"
Oct 30 11:08:34.107544 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.107471    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"]
Oct 30 11:08:34.107783 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.107771    4488 cpu_manager.go:414] "containerMap: removing container" podUID="5a4b21f8-ff6a-4d25-aa74-de55f4cf9957" containerName="curl"
Oct 30 11:08:34.107829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.107785    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a4b21f8-ff6a-4d25-aa74-de55f4cf9957" containerName="curl"
Oct 30 11:08:34.107864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.107835    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a4b21f8-ff6a-4d25-aa74-de55f4cf9957" containerName="curl"
Oct 30 11:08:34.110492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.110477    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"
Oct 30 11:08:34.120789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.120771    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"
Oct 30 11:08:34.125705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.125680    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"]
Oct 30 11:08:34.385691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.385626    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"
Oct 30 11:08:34.385691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.385639    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b" event={"ID":"5a4b21f8-ff6a-4d25-aa74-de55f4cf9957","Type":"ContainerDied","Data":"71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81"}
Oct 30 11:08:34.385691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.385672    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71b8a2f23c7bc7c2a83aa4bd37a824fcbc06a374701a3b55b51ba98df18d3b81"
Oct 30 11:08:34.416138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:34.415945    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"]
Oct 30 11:08:34.418735 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:08:34.418711    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podade78639_d53c_4420_a77d_bb35fcb1ab90.slice/crio-87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6 WatchSource:0}: Error finding container 87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6: Status 404 returned error can't find the container with id 87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6
Oct 30 11:08:35.391309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:35.391268    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302" event={"ID":"ade78639-d53c-4420-a77d-bb35fcb1ab90","Type":"ContainerStarted","Data":"7821b3328dacde5a45dc795fcfe37b6da18b56a7d1321ea783a602a511da9167"}
Oct 30 11:08:35.391703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:35.391314    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302" event={"ID":"ade78639-d53c-4420-a77d-bb35fcb1ab90","Type":"ContainerStarted","Data":"87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6"}
Oct 30 11:08:35.433097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:35.433054    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302" podStartSLOduration=1.433042063 podStartE2EDuration="1.433042063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:08:35.432473833 +0000 UTC m=+1411.778065687" watchObservedRunningTime="2026-10-30 11:08:35.433042063 +0000 UTC m=+1411.778633916"
Oct 30 11:08:45.442765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:45.442729    4488 generic.go:356] "Generic (PLEG): container finished" podID="ade78639-d53c-4420-a77d-bb35fcb1ab90" containerID="7821b3328dacde5a45dc795fcfe37b6da18b56a7d1321ea783a602a511da9167" exitCode=0
Oct 30 11:08:45.443151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:45.442798    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302" event={"ID":"ade78639-d53c-4420-a77d-bb35fcb1ab90","Type":"ContainerDied","Data":"7821b3328dacde5a45dc795fcfe37b6da18b56a7d1321ea783a602a511da9167"}
Oct 30 11:08:46.571023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:46.570998    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"
Oct 30 11:08:47.452379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:47.452334    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302" event={"ID":"ade78639-d53c-4420-a77d-bb35fcb1ab90","Type":"ContainerDied","Data":"87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6"}
Oct 30 11:08:47.452379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:47.452382    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87f3b280d10d01dff6e5575b8be681d2881e0f6fa7dd082520b752779a0ad6e6"
Oct 30 11:08:47.452379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:47.452356    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"
Oct 30 11:08:48.324489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.324459    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"]
Oct 30 11:08:48.324856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.324752    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ade78639-d53c-4420-a77d-bb35fcb1ab90" containerName="curl"
Oct 30 11:08:48.324856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.324762    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ade78639-d53c-4420-a77d-bb35fcb1ab90" containerName="curl"
Oct 30 11:08:48.324856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.324831    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ade78639-d53c-4420-a77d-bb35fcb1ab90" containerName="curl"
Oct 30 11:08:48.327512 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.327495    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"
Oct 30 11:08:48.337700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.337680    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"
Oct 30 11:08:48.344017 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.343994    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"]
Oct 30 11:08:48.635856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:48.635735    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"]
Oct 30 11:08:48.638355 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:08:48.638310    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b38901_6035_4061_bab4_c5f56fe94868.slice/crio-ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6 WatchSource:0}: Error finding container ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6: Status 404 returned error can't find the container with id ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6
Oct 30 11:08:49.461976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:49.461942    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61" event={"ID":"49b38901-6035-4061-bab4-c5f56fe94868","Type":"ContainerStarted","Data":"d1bf1eb346df174822498a0d57044ed493941b572f5387ebac7af318d7602691"}
Oct 30 11:08:49.462466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:49.461984    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61" event={"ID":"49b38901-6035-4061-bab4-c5f56fe94868","Type":"ContainerStarted","Data":"ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6"}
Oct 30 11:08:49.505166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:49.505121    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61" podStartSLOduration=1.5051071230000002 podStartE2EDuration="1.505107123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:08:49.50388752 +0000 UTC m=+1425.849479374" watchObservedRunningTime="2026-10-30 11:08:49.505107123 +0000 UTC m=+1425.850698977"
Oct 30 11:08:59.504177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:59.504142    4488 generic.go:356] "Generic (PLEG): container finished" podID="49b38901-6035-4061-bab4-c5f56fe94868" containerID="d1bf1eb346df174822498a0d57044ed493941b572f5387ebac7af318d7602691" exitCode=0
Oct 30 11:08:59.504600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:08:59.504214    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61" event={"ID":"49b38901-6035-4061-bab4-c5f56fe94868","Type":"ContainerDied","Data":"d1bf1eb346df174822498a0d57044ed493941b572f5387ebac7af318d7602691"}
Oct 30 11:09:00.640383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:00.640359    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"
Oct 30 11:09:01.478856 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:09:01.478819    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:09:01.514985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:01.514955    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"
Oct 30 11:09:01.515120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:01.514985    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61" event={"ID":"49b38901-6035-4061-bab4-c5f56fe94868","Type":"ContainerDied","Data":"ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6"}
Oct 30 11:09:01.515120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:01.515026    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec421fda1fb101cc4995984d762ba618b0904e8a415d7f93b5e795c29105e5d6"
Oct 30 11:09:02.549437 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.549406    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"]
Oct 30 11:09:02.549804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.549728    4488 cpu_manager.go:414] "containerMap: removing container" podUID="49b38901-6035-4061-bab4-c5f56fe94868" containerName="curl"
Oct 30 11:09:02.549804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.549740    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49b38901-6035-4061-bab4-c5f56fe94868" containerName="curl"
Oct 30 11:09:02.549804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.549785    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="49b38901-6035-4061-bab4-c5f56fe94868" containerName="curl"
Oct 30 11:09:02.552574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.552557    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"
Oct 30 11:09:02.562774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.562754    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"
Oct 30 11:09:02.568529 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.568507    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"]
Oct 30 11:09:02.858987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:02.858958    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"]
Oct 30 11:09:02.861482 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:02.861458    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87599215_376a_4acf_b91b_a1fb8057bff1.slice/crio-0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464 WatchSource:0}: Error finding container 0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464: Status 404 returned error can't find the container with id 0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464
Oct 30 11:09:03.530820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:03.530787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a" event={"ID":"87599215-376a-4acf-b91b-a1fb8057bff1","Type":"ContainerStarted","Data":"e6d0fdef53daa6459c3ef3ff40e2186c3bfbfcb1874332226eebc818feddd4a4"}
Oct 30 11:09:03.530820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:03.530825    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a" event={"ID":"87599215-376a-4acf-b91b-a1fb8057bff1","Type":"ContainerStarted","Data":"0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464"}
Oct 30 11:09:03.572773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:03.572730    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a" podStartSLOduration=1.572717937 podStartE2EDuration="1.572717937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:09:03.572178814 +0000 UTC m=+1439.917770669" watchObservedRunningTime="2026-10-30 11:09:03.572717937 +0000 UTC m=+1439.918309790"
Oct 30 11:09:13.570281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:13.570239    4488 generic.go:356] "Generic (PLEG): container finished" podID="87599215-376a-4acf-b91b-a1fb8057bff1" containerID="e6d0fdef53daa6459c3ef3ff40e2186c3bfbfcb1874332226eebc818feddd4a4" exitCode=0
Oct 30 11:09:13.570675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:13.570308    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a" event={"ID":"87599215-376a-4acf-b91b-a1fb8057bff1","Type":"ContainerDied","Data":"e6d0fdef53daa6459c3ef3ff40e2186c3bfbfcb1874332226eebc818feddd4a4"}
Oct 30 11:09:14.701445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:14.701418    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"
Oct 30 11:09:15.580111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:15.580080    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a" event={"ID":"87599215-376a-4acf-b91b-a1fb8057bff1","Type":"ContainerDied","Data":"0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464"}
Oct 30 11:09:15.580111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:15.580101    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"
Oct 30 11:09:15.580111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:15.580116    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b459183d19d7c8cf36d7eb2c770a593e52702d7352ba550abbaa134b141c464"
Oct 30 11:09:16.795164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.795125    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"]
Oct 30 11:09:16.795661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.795587    4488 cpu_manager.go:414] "containerMap: removing container" podUID="87599215-376a-4acf-b91b-a1fb8057bff1" containerName="curl"
Oct 30 11:09:16.795661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.795605    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87599215-376a-4acf-b91b-a1fb8057bff1" containerName="curl"
Oct 30 11:09:16.795782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.795686    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="87599215-376a-4acf-b91b-a1fb8057bff1" containerName="curl"
Oct 30 11:09:16.798527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.798506    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"
Oct 30 11:09:16.813831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.813805    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"]
Oct 30 11:09:16.826657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.826638    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:16.829752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:16.829735    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"
Oct 30 11:09:17.129624 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:17.129601    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"]
Oct 30 11:09:17.131595 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:17.131551    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cc90c69_1011_4b39_bff4_e547b8ef28ad.slice/crio-88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723 WatchSource:0}: Error finding container 88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723: Status 404 returned error can't find the container with id 88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723
Oct 30 11:09:17.590703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:17.590668    4488 generic.go:356] "Generic (PLEG): container finished" podID="3cc90c69-1011-4b39-bff4-e547b8ef28ad" containerID="f41f4c78a67dc0b8aed6081a3387240b8f9e3335787894611592e4d1d14274c4" exitCode=0
Oct 30 11:09:17.590875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:17.590726    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd" event={"ID":"3cc90c69-1011-4b39-bff4-e547b8ef28ad","Type":"ContainerDied","Data":"f41f4c78a67dc0b8aed6081a3387240b8f9e3335787894611592e4d1d14274c4"}
Oct 30 11:09:17.590875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:17.590757    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd" event={"ID":"3cc90c69-1011-4b39-bff4-e547b8ef28ad","Type":"ContainerStarted","Data":"88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723"}
Oct 30 11:09:18.719532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.719510    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"
Oct 30 11:09:18.904442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.904371    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"]
Oct 30 11:09:18.904684 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.904672    4488 cpu_manager.go:414] "containerMap: removing container" podUID="3cc90c69-1011-4b39-bff4-e547b8ef28ad" containerName="curl"
Oct 30 11:09:18.904779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.904685    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cc90c69-1011-4b39-bff4-e547b8ef28ad" containerName="curl"
Oct 30 11:09:18.904779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.904735    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cc90c69-1011-4b39-bff4-e547b8ef28ad" containerName="curl"
Oct 30 11:09:18.907510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.907494    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"
Oct 30 11:09:18.917646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.917627    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"
Oct 30 11:09:18.923830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:18.923806    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"]
Oct 30 11:09:19.213473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.213450    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"]
Oct 30 11:09:19.215248 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:19.215224    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1180afe6_27b5_4532_b1ce_d0e023e3c59b.slice/crio-377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae WatchSource:0}: Error finding container 377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae: Status 404 returned error can't find the container with id 377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae
Oct 30 11:09:19.600462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.600393    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"
Oct 30 11:09:19.600462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.600438    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd" event={"ID":"3cc90c69-1011-4b39-bff4-e547b8ef28ad","Type":"ContainerDied","Data":"88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723"}
Oct 30 11:09:19.600625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.600477    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88f80e228c5db0e576e9a9abab605d5a1ea6c4cc97771492b598b6f89c1a6723"
Oct 30 11:09:19.601980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.601957    4488 generic.go:356] "Generic (PLEG): container finished" podID="1180afe6-27b5-4532-b1ce-d0e023e3c59b" containerID="58b8f4138c85dd35eadafa607e29ff74804182591b2dd5100f7406a39fecda1e" exitCode=0
Oct 30 11:09:19.602085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.601989    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c" event={"ID":"1180afe6-27b5-4532-b1ce-d0e023e3c59b","Type":"ContainerDied","Data":"58b8f4138c85dd35eadafa607e29ff74804182591b2dd5100f7406a39fecda1e"}
Oct 30 11:09:19.602085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:19.602021    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c" event={"ID":"1180afe6-27b5-4532-b1ce-d0e023e3c59b","Type":"ContainerStarted","Data":"377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae"}
Oct 30 11:09:20.727561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:20.727536    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"
Oct 30 11:09:21.025322 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.025292    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"]
Oct 30 11:09:21.025614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.025601    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1180afe6-27b5-4532-b1ce-d0e023e3c59b" containerName="curl"
Oct 30 11:09:21.025662 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.025615    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1180afe6-27b5-4532-b1ce-d0e023e3c59b" containerName="curl"
Oct 30 11:09:21.025699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.025690    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1180afe6-27b5-4532-b1ce-d0e023e3c59b" containerName="curl"
Oct 30 11:09:21.028490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.028475    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"
Oct 30 11:09:21.038602 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.038583    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"
Oct 30 11:09:21.042849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.042828    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"]
Oct 30 11:09:21.334722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.334700    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"]
Oct 30 11:09:21.336621 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:21.336594    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9ce9508_1531_4324_a694_2605e97afdfe.slice/crio-1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5 WatchSource:0}: Error finding container 1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5: Status 404 returned error can't find the container with id 1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5
Oct 30 11:09:21.615563 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.615498    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"
Oct 30 11:09:21.615563 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.615546    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c" event={"ID":"1180afe6-27b5-4532-b1ce-d0e023e3c59b","Type":"ContainerDied","Data":"377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae"}
Oct 30 11:09:21.615765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.615588    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="377f5c1625f8dd227980e81ec3dba57d1125e3ccf56db6bdb1d9fec0ade425ae"
Oct 30 11:09:21.617063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.617037    4488 generic.go:356] "Generic (PLEG): container finished" podID="d9ce9508-1531-4324-a694-2605e97afdfe" containerID="ed4ce34b17156c74093e6957314046da609e8b1b990dc537a38c3feba5bc2825" exitCode=0
Oct 30 11:09:21.617169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.617063    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee" event={"ID":"d9ce9508-1531-4324-a694-2605e97afdfe","Type":"ContainerDied","Data":"ed4ce34b17156c74093e6957314046da609e8b1b990dc537a38c3feba5bc2825"}
Oct 30 11:09:21.617169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:21.617099    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee" event={"ID":"d9ce9508-1531-4324-a694-2605e97afdfe","Type":"ContainerStarted","Data":"1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5"}
Oct 30 11:09:22.747619 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:22.747596    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"
Oct 30 11:09:23.136184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.136155    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"]
Oct 30 11:09:23.136477 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.136463    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d9ce9508-1531-4324-a694-2605e97afdfe" containerName="curl"
Oct 30 11:09:23.136528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.136478    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9ce9508-1531-4324-a694-2605e97afdfe" containerName="curl"
Oct 30 11:09:23.136564 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.136555    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9ce9508-1531-4324-a694-2605e97afdfe" containerName="curl"
Oct 30 11:09:23.138993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.138976    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"
Oct 30 11:09:23.149480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.149463    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"
Oct 30 11:09:23.155470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.155449    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"]
Oct 30 11:09:23.444912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.444886    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"]
Oct 30 11:09:23.446519 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:23.446493    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d1abc5e_48ea_496d_9070_e5761375d2e7.slice/crio-d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69 WatchSource:0}: Error finding container d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69: Status 404 returned error can't find the container with id d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69
Oct 30 11:09:23.627721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.627691    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"
Oct 30 11:09:23.627845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.627718    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee" event={"ID":"d9ce9508-1531-4324-a694-2605e97afdfe","Type":"ContainerDied","Data":"1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5"}
Oct 30 11:09:23.627845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.627752    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1995cbd7836e84cc3536ee6cf99acef1a80476aa5548f4f8028b160bca747bf5"
Oct 30 11:09:23.629337 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.629316    4488 generic.go:356] "Generic (PLEG): container finished" podID="0d1abc5e-48ea-496d-9070-e5761375d2e7" containerID="882af69e47adea9118b07adbb2f39b386a150f8d2504b81a2c1329f3895707e6" exitCode=0
Oct 30 11:09:23.629337 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.629354    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235" event={"ID":"0d1abc5e-48ea-496d-9070-e5761375d2e7","Type":"ContainerDied","Data":"882af69e47adea9118b07adbb2f39b386a150f8d2504b81a2c1329f3895707e6"}
Oct 30 11:09:23.629503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:23.629374    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235" event={"ID":"0d1abc5e-48ea-496d-9070-e5761375d2e7","Type":"ContainerStarted","Data":"d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69"}
Oct 30 11:09:24.760061 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:24.760038    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"
Oct 30 11:09:25.257695 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.257665    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"]
Oct 30 11:09:25.257989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.257976    4488 cpu_manager.go:414] "containerMap: removing container" podUID="0d1abc5e-48ea-496d-9070-e5761375d2e7" containerName="curl"
Oct 30 11:09:25.258028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.257991    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d1abc5e-48ea-496d-9070-e5761375d2e7" containerName="curl"
Oct 30 11:09:25.258059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.258054    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d1abc5e-48ea-496d-9070-e5761375d2e7" containerName="curl"
Oct 30 11:09:25.260898 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.260883    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"
Oct 30 11:09:25.270857 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.270839    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"
Oct 30 11:09:25.276826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.276804    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"]
Oct 30 11:09:25.567242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.567220    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"]
Oct 30 11:09:25.575991 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:25.569371    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9d247b1_0744_4431_a5d9_1f85cd0b8521.slice/crio-60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888 WatchSource:0}: Error finding container 60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888: Status 404 returned error can't find the container with id 60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888
Oct 30 11:09:25.638209 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.638181    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8" event={"ID":"b9d247b1-0744-4431-a5d9-1f85cd0b8521","Type":"ContainerStarted","Data":"c74d3bf3461f0f582c5cd39bbeaab88b5debb16805bbc0a5cbcbf99a2cce225c"}
Oct 30 11:09:25.638316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.638223    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8" event={"ID":"b9d247b1-0744-4431-a5d9-1f85cd0b8521","Type":"ContainerStarted","Data":"60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888"}
Oct 30 11:09:25.639672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.639646    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235" event={"ID":"0d1abc5e-48ea-496d-9070-e5761375d2e7","Type":"ContainerDied","Data":"d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69"}
Oct 30 11:09:25.639749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.639669    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"
Oct 30 11:09:25.639749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.639682    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d731fb617a541d6045314c8be1b5535dbb6f34219182ca64ed90c3f1cb948d69"
Oct 30 11:09:25.680420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:25.680385    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8" podStartSLOduration=0.680373984 podStartE2EDuration="680.373984ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:09:25.680190819 +0000 UTC m=+1462.025782676" watchObservedRunningTime="2026-10-30 11:09:25.680373984 +0000 UTC m=+1462.025965835"
Oct 30 11:09:26.646250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:26.646206    4488 generic.go:356] "Generic (PLEG): container finished" podID="b9d247b1-0744-4431-a5d9-1f85cd0b8521" containerID="c74d3bf3461f0f582c5cd39bbeaab88b5debb16805bbc0a5cbcbf99a2cce225c" exitCode=0
Oct 30 11:09:26.646740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:26.646291    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8" event={"ID":"b9d247b1-0744-4431-a5d9-1f85cd0b8521","Type":"ContainerDied","Data":"c74d3bf3461f0f582c5cd39bbeaab88b5debb16805bbc0a5cbcbf99a2cce225c"}
Oct 30 11:09:27.770752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:27.770722    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"
Oct 30 11:09:28.655578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:28.655549    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"
Oct 30 11:09:28.655578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:28.655576    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8" event={"ID":"b9d247b1-0744-4431-a5d9-1f85cd0b8521","Type":"ContainerDied","Data":"60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888"}
Oct 30 11:09:28.655761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:28.655611    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60fb51abf899fe70fc26b089008c3d759e84b8552b3861fc679ea2d78a301888"
Oct 30 11:09:29.403709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.403678    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"]
Oct 30 11:09:29.404070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.403958    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b9d247b1-0744-4431-a5d9-1f85cd0b8521" containerName="curl"
Oct 30 11:09:29.404070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.403969    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9d247b1-0744-4431-a5d9-1f85cd0b8521" containerName="curl"
Oct 30 11:09:29.404070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.404032    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9d247b1-0744-4431-a5d9-1f85cd0b8521" containerName="curl"
Oct 30 11:09:29.406871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.406853    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"
Oct 30 11:09:29.420169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.420147    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"]
Oct 30 11:09:29.432821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.432801    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:29.437917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.437897    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"
Oct 30 11:09:29.733883 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:29.733851    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"]
Oct 30 11:09:29.736730 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:29.736696    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d4c0b10_c79c_4f1b_8d51_1ff1c70b7504.slice/crio-37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e WatchSource:0}: Error finding container 37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e: Status 404 returned error can't find the container with id 37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e
Oct 30 11:09:30.668401 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:30.668367    4488 generic.go:356] "Generic (PLEG): container finished" podID="2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504" containerID="1f13d387e8997d09cd861124f86aa36fd95c46d87409ffe9d27eeca7eae97474" exitCode=0
Oct 30 11:09:30.668806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:30.668406    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6" event={"ID":"2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504","Type":"ContainerDied","Data":"1f13d387e8997d09cd861124f86aa36fd95c46d87409ffe9d27eeca7eae97474"}
Oct 30 11:09:30.668806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:30.668432    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6" event={"ID":"2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504","Type":"ContainerStarted","Data":"37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e"}
Oct 30 11:09:31.477478 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:09:31.477436    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:09:31.799600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:31.799567    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"
Oct 30 11:09:32.677269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:32.677243    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"
Oct 30 11:09:32.677269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:32.677257    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6" event={"ID":"2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504","Type":"ContainerDied","Data":"37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e"}
Oct 30 11:09:32.677494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:32.677288    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37c76123402f80b7402bf13a79a9dff37c30fa5e60be491c4e24978f1e7b743e"
Oct 30 11:09:33.544710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.544679    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"]
Oct 30 11:09:33.545067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.544970    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504" containerName="curl"
Oct 30 11:09:33.545067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.544981    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504" containerName="curl"
Oct 30 11:09:33.545067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.545035    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504" containerName="curl"
Oct 30 11:09:33.547899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.547884    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"
Oct 30 11:09:33.567453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.567427    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:33.568484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.568463    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"
Oct 30 11:09:33.581610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.581589    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"]
Oct 30 11:09:33.866523 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:33.866501    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"]
Oct 30 11:09:33.868331 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:33.868306    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefdd69bc_7619_4808_9c68_d47dc3bed06e.slice/crio-f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279 WatchSource:0}: Error finding container f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279: Status 404 returned error can't find the container with id f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279
Oct 30 11:09:34.687315 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:34.687281    4488 generic.go:356] "Generic (PLEG): container finished" podID="efdd69bc-7619-4808-9c68-d47dc3bed06e" containerID="07a2c9a229f5fabea2f55eccef61f6e206e15025719f30c45f4d7b86f7e53189" exitCode=0
Oct 30 11:09:34.687699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:34.687328    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5" event={"ID":"efdd69bc-7619-4808-9c68-d47dc3bed06e","Type":"ContainerDied","Data":"07a2c9a229f5fabea2f55eccef61f6e206e15025719f30c45f4d7b86f7e53189"}
Oct 30 11:09:34.687699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:34.687375    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5" event={"ID":"efdd69bc-7619-4808-9c68-d47dc3bed06e","Type":"ContainerStarted","Data":"f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279"}
Oct 30 11:09:35.817723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:35.817697    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"
Oct 30 11:09:36.697713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:36.697682    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"
Oct 30 11:09:36.697713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:36.697701    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5" event={"ID":"efdd69bc-7619-4808-9c68-d47dc3bed06e","Type":"ContainerDied","Data":"f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279"}
Oct 30 11:09:36.697920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:36.697736    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8e650cef860c5cd98123316da6ee3944cfb5d961a1de78dbf45efd033d49279"
Oct 30 11:09:37.683525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.683492    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"]
Oct 30 11:09:37.683988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.683971    4488 cpu_manager.go:414] "containerMap: removing container" podUID="efdd69bc-7619-4808-9c68-d47dc3bed06e" containerName="curl"
Oct 30 11:09:37.684034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.683989    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efdd69bc-7619-4808-9c68-d47dc3bed06e" containerName="curl"
Oct 30 11:09:37.684070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.684044    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="efdd69bc-7619-4808-9c68-d47dc3bed06e" containerName="curl"
Oct 30 11:09:37.686876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.686861    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"
Oct 30 11:09:37.702443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.702421    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"]
Oct 30 11:09:37.714957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.714936    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:37.718062 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:37.718043    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"
Oct 30 11:09:38.012883 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:38.012858    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"]
Oct 30 11:09:38.015315 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:38.015281    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a4a98e_9590_430c_862c_1a9d38664134.slice/crio-afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9 WatchSource:0}: Error finding container afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9: Status 404 returned error can't find the container with id afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9
Oct 30 11:09:38.709351 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:38.709308    4488 generic.go:356] "Generic (PLEG): container finished" podID="24a4a98e-9590-430c-862c-1a9d38664134" containerID="e721da619bcfafdd36f3f894efbd78ed6ec3eafefed34b1925adf1adc14189a2" exitCode=0
Oct 30 11:09:38.709717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:38.709399    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675" event={"ID":"24a4a98e-9590-430c-862c-1a9d38664134","Type":"ContainerDied","Data":"e721da619bcfafdd36f3f894efbd78ed6ec3eafefed34b1925adf1adc14189a2"}
Oct 30 11:09:38.709717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:38.709444    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675" event={"ID":"24a4a98e-9590-430c-862c-1a9d38664134","Type":"ContainerStarted","Data":"afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9"}
Oct 30 11:09:39.846671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:39.846649    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"
Oct 30 11:09:40.719229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:40.719199    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"
Oct 30 11:09:40.719229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:40.719217    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675" event={"ID":"24a4a98e-9590-430c-862c-1a9d38664134","Type":"ContainerDied","Data":"afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9"}
Oct 30 11:09:40.719418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:40.719250    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afdf51eaf0bfc154f96ff26643dfc133323077f8239b0acb5a0bb28c2db811a9"
Oct 30 11:09:41.815239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.815208    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"]
Oct 30 11:09:41.815632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.815520    4488 cpu_manager.go:414] "containerMap: removing container" podUID="24a4a98e-9590-430c-862c-1a9d38664134" containerName="curl"
Oct 30 11:09:41.815632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.815533    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24a4a98e-9590-430c-862c-1a9d38664134" containerName="curl"
Oct 30 11:09:41.815632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.815599    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="24a4a98e-9590-430c-862c-1a9d38664134" containerName="curl"
Oct 30 11:09:41.818421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.818406    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"
Oct 30 11:09:41.833782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.833760    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"]
Oct 30 11:09:41.846669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.846651    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:41.849729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:41.849711    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"
Oct 30 11:09:42.146858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:42.146655    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"]
Oct 30 11:09:42.148937 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:42.148911    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod375a7dfd_11ea_47c3_a823_bce222f9c268.slice/crio-5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5 WatchSource:0}: Error finding container 5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5: Status 404 returned error can't find the container with id 5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5
Oct 30 11:09:42.730237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:42.730201    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab" event={"ID":"375a7dfd-11ea-47c3-a823-bce222f9c268","Type":"ContainerStarted","Data":"f9edfe9607353a0ccdd3c6b57a48fb407958f60fc5e5802e1ce810ccd09b3e63"}
Oct 30 11:09:42.730427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:42.730252    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab" event={"ID":"375a7dfd-11ea-47c3-a823-bce222f9c268","Type":"ContainerStarted","Data":"5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5"}
Oct 30 11:09:42.772796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:42.772756    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab" podStartSLOduration=1.772742211 podStartE2EDuration="1.772742211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:09:42.772184166 +0000 UTC m=+1479.117775998" watchObservedRunningTime="2026-10-30 11:09:42.772742211 +0000 UTC m=+1479.118334061"
Oct 30 11:09:52.775733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:52.775695    4488 generic.go:356] "Generic (PLEG): container finished" podID="375a7dfd-11ea-47c3-a823-bce222f9c268" containerID="f9edfe9607353a0ccdd3c6b57a48fb407958f60fc5e5802e1ce810ccd09b3e63" exitCode=0
Oct 30 11:09:52.776184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:52.775740    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab" event={"ID":"375a7dfd-11ea-47c3-a823-bce222f9c268","Type":"ContainerDied","Data":"f9edfe9607353a0ccdd3c6b57a48fb407958f60fc5e5802e1ce810ccd09b3e63"}
Oct 30 11:09:53.924028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:53.924005    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"
Oct 30 11:09:54.786120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:54.786085    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab" event={"ID":"375a7dfd-11ea-47c3-a823-bce222f9c268","Type":"ContainerDied","Data":"5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5"}
Oct 30 11:09:54.786120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:54.786115    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"
Oct 30 11:09:54.786120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:54.786124    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fdd4f306cd17824fbfc666d842b6df6093a2298cffcb7a5f58250ae04fc56c5"
Oct 30 11:09:56.040160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.040127    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"]
Oct 30 11:09:56.040560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.040445    4488 cpu_manager.go:414] "containerMap: removing container" podUID="375a7dfd-11ea-47c3-a823-bce222f9c268" containerName="curl"
Oct 30 11:09:56.040560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.040458    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="375a7dfd-11ea-47c3-a823-bce222f9c268" containerName="curl"
Oct 30 11:09:56.040560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.040515    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="375a7dfd-11ea-47c3-a823-bce222f9c268" containerName="curl"
Oct 30 11:09:56.043439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.043423    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"
Oct 30 11:09:56.059073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.059044    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"]
Oct 30 11:09:56.071909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.071888    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e349f61b3868cb\"/\"default-dockercfg-j5jhc\""
Oct 30 11:09:56.074867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.074849    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"
Oct 30 11:09:56.370917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.370894    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"]
Oct 30 11:09:56.373611 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:09:56.373586    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2965d86d_bc7a_4c88_b7d3_3407529e3a16.slice/crio-eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1 WatchSource:0}: Error finding container eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1: Status 404 returned error can't find the container with id eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1
Oct 30 11:09:56.796534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.796495    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a" event={"ID":"2965d86d-bc7a-4c88-b7d3-3407529e3a16","Type":"ContainerStarted","Data":"e48444e83f5c690006e5394d87f6e8641f0f06c49e38a9f93633e69ac586c956"}
Oct 30 11:09:56.796694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.796543    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a" event={"ID":"2965d86d-bc7a-4c88-b7d3-3407529e3a16","Type":"ContainerStarted","Data":"eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1"}
Oct 30 11:09:56.839242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:09:56.839195    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a" podStartSLOduration=0.83918191 podStartE2EDuration="839.18191ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:09:56.83816162 +0000 UTC m=+1493.183753474" watchObservedRunningTime="2026-10-30 11:09:56.83918191 +0000 UTC m=+1493.184773792"
Oct 30 11:10:01.477904 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:10:01.477869    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:10:06.840820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:06.840742    4488 generic.go:356] "Generic (PLEG): container finished" podID="2965d86d-bc7a-4c88-b7d3-3407529e3a16" containerID="e48444e83f5c690006e5394d87f6e8641f0f06c49e38a9f93633e69ac586c956" exitCode=0
Oct 30 11:10:06.840820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:06.840775    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a" event={"ID":"2965d86d-bc7a-4c88-b7d3-3407529e3a16","Type":"ContainerDied","Data":"e48444e83f5c690006e5394d87f6e8641f0f06c49e38a9f93633e69ac586c956"}
Oct 30 11:10:07.961925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:07.961900    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"
Oct 30 11:10:08.237082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.237048    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"]
Oct 30 11:10:08.237438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.237421    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2965d86d-bc7a-4c88-b7d3-3407529e3a16" containerName="curl"
Oct 30 11:10:08.237528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.237440    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2965d86d-bc7a-4c88-b7d3-3407529e3a16" containerName="curl"
Oct 30 11:10:08.237528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.237524    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2965d86d-bc7a-4c88-b7d3-3407529e3a16" containerName="curl"
Oct 30 11:10:08.240195 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.240176    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"
Oct 30 11:10:08.250530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.250513    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"
Oct 30 11:10:08.256516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.256497    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"]
Oct 30 11:10:08.548295 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.548249    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"]
Oct 30 11:10:08.550898 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:08.550873    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2efcf6d_86f8_4146_90f6_94e1009a4de9.slice/crio-5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687 WatchSource:0}: Error finding container 5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687: Status 404 returned error can't find the container with id 5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687
Oct 30 11:10:08.850607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.850521    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad" event={"ID":"b2efcf6d-86f8-4146-90f6-94e1009a4de9","Type":"ContainerStarted","Data":"a627daca84da79904aca30982a1e5ddb1fdc5ab1f784b075ceacfbfe3b662d58"}
Oct 30 11:10:08.850607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.850566    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad" event={"ID":"b2efcf6d-86f8-4146-90f6-94e1009a4de9","Type":"ContainerStarted","Data":"5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687"}
Oct 30 11:10:08.851733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.851710    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a" event={"ID":"2965d86d-bc7a-4c88-b7d3-3407529e3a16","Type":"ContainerDied","Data":"eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1"}
Oct 30 11:10:08.851865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.851739    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaae341b83b3ad350c5a4341af9af1d56d193b192076744fc0e5c1105b73b3e1"
Oct 30 11:10:08.851865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.851747    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"
Oct 30 11:10:08.896546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:08.896509    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad" podStartSLOduration=0.896495848 podStartE2EDuration="896.495848ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:10:08.895222295 +0000 UTC m=+1505.240814149" watchObservedRunningTime="2026-10-30 11:10:08.896495848 +0000 UTC m=+1505.242087732"
Oct 30 11:10:18.895492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:18.895423    4488 generic.go:356] "Generic (PLEG): container finished" podID="b2efcf6d-86f8-4146-90f6-94e1009a4de9" containerID="a627daca84da79904aca30982a1e5ddb1fdc5ab1f784b075ceacfbfe3b662d58" exitCode=0
Oct 30 11:10:18.895809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:18.895492    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad" event={"ID":"b2efcf6d-86f8-4146-90f6-94e1009a4de9","Type":"ContainerDied","Data":"a627daca84da79904aca30982a1e5ddb1fdc5ab1f784b075ceacfbfe3b662d58"}
Oct 30 11:10:20.028045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.028018    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"
Oct 30 11:10:20.445334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.445307    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"]
Oct 30 11:10:20.445635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.445622    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b2efcf6d-86f8-4146-90f6-94e1009a4de9" containerName="curl"
Oct 30 11:10:20.445680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.445636    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2efcf6d-86f8-4146-90f6-94e1009a4de9" containerName="curl"
Oct 30 11:10:20.445757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.445703    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2efcf6d-86f8-4146-90f6-94e1009a4de9" containerName="curl"
Oct 30 11:10:20.448498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.448480    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"
Oct 30 11:10:20.458621 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.458601    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"
Oct 30 11:10:20.467428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.467405    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"]
Oct 30 11:10:20.759370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.759284    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"]
Oct 30 11:10:20.762750 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:20.762722    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0386d91_5d78_4ef6_8271_c073e7f13a3c.slice/crio-2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180 WatchSource:0}: Error finding container 2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180: Status 404 returned error can't find the container with id 2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180
Oct 30 11:10:20.905893 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.905867    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"
Oct 30 11:10:20.906045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.905867    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad" event={"ID":"b2efcf6d-86f8-4146-90f6-94e1009a4de9","Type":"ContainerDied","Data":"5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687"}
Oct 30 11:10:20.906045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.905977    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b1c383edd06480ca1334faddc1308c24f3e6e20341e6f6f8d1f65aae33c8687"
Oct 30 11:10:20.907601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.907577    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f" event={"ID":"e0386d91-5d78-4ef6-8271-c073e7f13a3c","Type":"ContainerStarted","Data":"70603e1ca33903977de97e53a3b7dd6b60ede1a255e8efe7b2bafe966be5c58c"}
Oct 30 11:10:20.907701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.907612    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f" event={"ID":"e0386d91-5d78-4ef6-8271-c073e7f13a3c","Type":"ContainerStarted","Data":"2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180"}
Oct 30 11:10:20.952796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:20.952754    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f" podStartSLOduration=0.95274218 podStartE2EDuration="952.74218ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:10:20.950750831 +0000 UTC m=+1517.296342686" watchObservedRunningTime="2026-10-30 11:10:20.95274218 +0000 UTC m=+1517.298334033"
Oct 30 11:10:30.964312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:30.964281    4488 generic.go:356] "Generic (PLEG): container finished" podID="e0386d91-5d78-4ef6-8271-c073e7f13a3c" containerID="70603e1ca33903977de97e53a3b7dd6b60ede1a255e8efe7b2bafe966be5c58c" exitCode=0
Oct 30 11:10:30.964653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:30.964315    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f" event={"ID":"e0386d91-5d78-4ef6-8271-c073e7f13a3c","Type":"ContainerDied","Data":"70603e1ca33903977de97e53a3b7dd6b60ede1a255e8efe7b2bafe966be5c58c"}
Oct 30 11:10:31.477803 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:10:31.477768    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:10:32.093418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.093394    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"
Oct 30 11:10:32.661444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.661412    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"]
Oct 30 11:10:32.662108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.662086    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e0386d91-5d78-4ef6-8271-c073e7f13a3c" containerName="curl"
Oct 30 11:10:32.662108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.662109    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0386d91-5d78-4ef6-8271-c073e7f13a3c" containerName="curl"
Oct 30 11:10:32.662297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.662252    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0386d91-5d78-4ef6-8271-c073e7f13a3c" containerName="curl"
Oct 30 11:10:32.666142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.666114    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"
Oct 30 11:10:32.676759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.676740    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"
Oct 30 11:10:32.685185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.685161    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"]
Oct 30 11:10:32.974515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.974478    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f" event={"ID":"e0386d91-5d78-4ef6-8271-c073e7f13a3c","Type":"ContainerDied","Data":"2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180"}
Oct 30 11:10:32.974515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.974507    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"
Oct 30 11:10:32.974704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.974521    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2395af6329d988107ff9d4cfd02fcd523ab2905a6cb0f0972fb63050ba25f180"
Oct 30 11:10:32.993864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:32.993807    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"]
Oct 30 11:10:32.996175 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:32.996152    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cef6ac9_c106_4018_a1f6_44c453845535.slice/crio-94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56 WatchSource:0}: Error finding container 94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56: Status 404 returned error can't find the container with id 94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56
Oct 30 11:10:33.979740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:33.979708    4488 generic.go:356] "Generic (PLEG): container finished" podID="3cef6ac9-c106-4018-a1f6-44c453845535" containerID="09331216142e3625130c2905a2b68342f0a7eece87dffbb8e00b04b3d176ef98" exitCode=0
Oct 30 11:10:33.980157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:33.979768    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136" event={"ID":"3cef6ac9-c106-4018-a1f6-44c453845535","Type":"ContainerDied","Data":"09331216142e3625130c2905a2b68342f0a7eece87dffbb8e00b04b3d176ef98"}
Oct 30 11:10:33.980157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:33.979793    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136" event={"ID":"3cef6ac9-c106-4018-a1f6-44c453845535","Type":"ContainerStarted","Data":"94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56"}
Oct 30 11:10:35.109180 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:35.109154    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"
Oct 30 11:10:35.989397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:35.989367    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136" event={"ID":"3cef6ac9-c106-4018-a1f6-44c453845535","Type":"ContainerDied","Data":"94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56"}
Oct 30 11:10:35.989397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:35.989401    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"
Oct 30 11:10:35.989596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:35.989403    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94fa2c469d857a275a3da84ea652ef31be64ada8a5c6ba892acc92f82edffa56"
Oct 30 11:10:36.819458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.819421    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"]
Oct 30 11:10:36.819833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.819730    4488 cpu_manager.go:414] "containerMap: removing container" podUID="3cef6ac9-c106-4018-a1f6-44c453845535" containerName="curl"
Oct 30 11:10:36.819833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.819740    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cef6ac9-c106-4018-a1f6-44c453845535" containerName="curl"
Oct 30 11:10:36.819833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.819790    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cef6ac9-c106-4018-a1f6-44c453845535" containerName="curl"
Oct 30 11:10:36.822665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.822648    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"
Oct 30 11:10:36.833169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.833149    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"
Oct 30 11:10:36.839572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:36.839550    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"]
Oct 30 11:10:37.129276 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:37.129252    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"]
Oct 30 11:10:37.131303 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:37.131271    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d9fc11c_0009_45b4_9f93_b3224fafd59b.slice/crio-008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148 WatchSource:0}: Error finding container 008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148: Status 404 returned error can't find the container with id 008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148
Oct 30 11:10:38.001217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:38.001180    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a" event={"ID":"2d9fc11c-0009-45b4-9f93-b3224fafd59b","Type":"ContainerStarted","Data":"fa7a60fbccf2afcb2638afbbf9ed50eb58f32a148f6930ef544b18b8aac26599"}
Oct 30 11:10:38.001642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:38.001230    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a" event={"ID":"2d9fc11c-0009-45b4-9f93-b3224fafd59b","Type":"ContainerStarted","Data":"008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148"}
Oct 30 11:10:38.043270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:38.043225    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a" podStartSLOduration=2.043209244 podStartE2EDuration="2.043209244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:10:38.042827033 +0000 UTC m=+1534.388418889" watchObservedRunningTime="2026-10-30 11:10:38.043209244 +0000 UTC m=+1534.388801096"
Oct 30 11:10:43.025560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:43.025527    4488 generic.go:356] "Generic (PLEG): container finished" podID="2d9fc11c-0009-45b4-9f93-b3224fafd59b" containerID="fa7a60fbccf2afcb2638afbbf9ed50eb58f32a148f6930ef544b18b8aac26599" exitCode=0
Oct 30 11:10:43.025926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:43.025598    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a" event={"ID":"2d9fc11c-0009-45b4-9f93-b3224fafd59b","Type":"ContainerDied","Data":"fa7a60fbccf2afcb2638afbbf9ed50eb58f32a148f6930ef544b18b8aac26599"}
Oct 30 11:10:44.159779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:44.159757    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"
Oct 30 11:10:45.004488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.004453    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"]
Oct 30 11:10:45.004800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.004786    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2d9fc11c-0009-45b4-9f93-b3224fafd59b" containerName="curl"
Oct 30 11:10:45.004800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.004799    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d9fc11c-0009-45b4-9f93-b3224fafd59b" containerName="curl"
Oct 30 11:10:45.004912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.004858    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d9fc11c-0009-45b4-9f93-b3224fafd59b" containerName="curl"
Oct 30 11:10:45.007936 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.007915    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:45.026329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.026299    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"]
Oct 30 11:10:45.038106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.038084    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:10:45.038244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.038232    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"
Oct 30 11:10:45.038312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.038286    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a" event={"ID":"2d9fc11c-0009-45b4-9f93-b3224fafd59b","Type":"ContainerDied","Data":"008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148"}
Oct 30 11:10:45.038376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.038325    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="008fa3b7b88838ada0667dcf415d79a7e5438931db95616b3d0021901a6e3148"
Oct 30 11:10:45.149726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.149700    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\") pod \"targetallocator-mtls-allowed-18e34a2f991dc217\" (UID: \"db3d7328-cdd1-4a9e-af76-9b179fe76b4f\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:45.250115 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.250089    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\") pod \"targetallocator-mtls-allowed-18e34a2f991dc217\" (UID: \"db3d7328-cdd1-4a9e-af76-9b179fe76b4f\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:45.252598 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.252570    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\") pod \"targetallocator-mtls-allowed-18e34a2f991dc217\" (UID: \"db3d7328-cdd1-4a9e-af76-9b179fe76b4f\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:45.318869 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.318821    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:45.613969 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:45.613924    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"]
Oct 30 11:10:45.616068 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:45.616041    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb3d7328_cdd1_4a9e_af76_9b179fe76b4f.slice/crio-0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323 WatchSource:0}: Error finding container 0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323: Status 404 returned error can't find the container with id 0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323
Oct 30 11:10:46.043871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:46.043838    4488 generic.go:356] "Generic (PLEG): container finished" podID="db3d7328-cdd1-4a9e-af76-9b179fe76b4f" containerID="ad42d85e164d8a476e7631cff0a04a6417c5adeefe201f8195ab8a4e95a42f2e" exitCode=0
Oct 30 11:10:46.044038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:46.043886    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217" event={"ID":"db3d7328-cdd1-4a9e-af76-9b179fe76b4f","Type":"ContainerDied","Data":"ad42d85e164d8a476e7631cff0a04a6417c5adeefe201f8195ab8a4e95a42f2e"}
Oct 30 11:10:46.044038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:46.043918    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217" event={"ID":"db3d7328-cdd1-4a9e-af76-9b179fe76b4f","Type":"ContainerStarted","Data":"0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323"}
Oct 30 11:10:47.167950 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:47.167926    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:47.267021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:47.266995    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\" (UniqueName: \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\") pod \"db3d7328-cdd1-4a9e-af76-9b179fe76b4f\" (UID: \"db3d7328-cdd1-4a9e-af76-9b179fe76b4f\") "
Oct 30 11:10:47.268896 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:47.268861    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate" pod "db3d7328-cdd1-4a9e-af76-9b179fe76b4f" (UID: "db3d7328-cdd1-4a9e-af76-9b179fe76b4f"). InnerVolumeSpecName "client-certificate". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:10:47.367959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:47.367907    4488 reconciler_common.go:299] "Volume detached for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/db3d7328-cdd1-4a9e-af76-9b179fe76b4f-client-certificate\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:10:48.055157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:48.055128    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"
Oct 30 11:10:48.055358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:48.055171    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217" event={"ID":"db3d7328-cdd1-4a9e-af76-9b179fe76b4f","Type":"ContainerDied","Data":"0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323"}
Oct 30 11:10:48.055358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:48.055210    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ff1f4f71b094d462db531ec63f1bb0a1f1c86cbd6ac22e57881441f2a48d323"
Oct 30 11:10:49.129786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.129753    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"]
Oct 30 11:10:49.130157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.130073    4488 cpu_manager.go:414] "containerMap: removing container" podUID="db3d7328-cdd1-4a9e-af76-9b179fe76b4f" containerName="curl"
Oct 30 11:10:49.130157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.130084    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db3d7328-cdd1-4a9e-af76-9b179fe76b4f" containerName="curl"
Oct 30 11:10:49.130157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.130145    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="db3d7328-cdd1-4a9e-af76-9b179fe76b4f" containerName="curl"
Oct 30 11:10:49.133149 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.133131    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"
Oct 30 11:10:49.143761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.143743    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"
Oct 30 11:10:49.148429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.148406    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"]
Oct 30 11:10:49.445411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:49.445313    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"]
Oct 30 11:10:49.447878 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:49.447851    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode24cf90d_4335_4562_b6f7_0bba903cf07f.slice/crio-31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c WatchSource:0}: Error finding container 31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c: Status 404 returned error can't find the container with id 31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c
Oct 30 11:10:50.067634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:50.067598    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa" event={"ID":"e24cf90d-4335-4562-b6f7-0bba903cf07f","Type":"ContainerStarted","Data":"bde1939ba2b9e5b82679fcc2ae424d49729a13668797aa8c178a61a07db0092c"}
Oct 30 11:10:50.067796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:50.067645    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa" event={"ID":"e24cf90d-4335-4562-b6f7-0bba903cf07f","Type":"ContainerStarted","Data":"31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c"}
Oct 30 11:10:50.111192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:50.111146    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa" podStartSLOduration=1.111132462 podStartE2EDuration="1.111132462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:10:50.110395034 +0000 UTC m=+1546.455986907" watchObservedRunningTime="2026-10-30 11:10:50.111132462 +0000 UTC m=+1546.456724342"
Oct 30 11:10:55.093673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:55.093641    4488 generic.go:356] "Generic (PLEG): container finished" podID="e24cf90d-4335-4562-b6f7-0bba903cf07f" containerID="bde1939ba2b9e5b82679fcc2ae424d49729a13668797aa8c178a61a07db0092c" exitCode=0
Oct 30 11:10:55.093673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:55.093687    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa" event={"ID":"e24cf90d-4335-4562-b6f7-0bba903cf07f","Type":"ContainerDied","Data":"bde1939ba2b9e5b82679fcc2ae424d49729a13668797aa8c178a61a07db0092c"}
Oct 30 11:10:56.219603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:56.219579    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"
Oct 30 11:10:57.103765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.103726    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa" event={"ID":"e24cf90d-4335-4562-b6f7-0bba903cf07f","Type":"ContainerDied","Data":"31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c"}
Oct 30 11:10:57.103765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.103742    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"
Oct 30 11:10:57.103765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.103765    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31547bdcf25e350fcbbf6b78d55ea5cd9b84e98c6a5c289f10d1fff8ba4e710c"
Oct 30 11:10:57.230142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.230114    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"]
Oct 30 11:10:57.234057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.234034    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e34a308f3640fa"]
Oct 30 11:10:57.255016 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.254992    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"]
Oct 30 11:10:57.259456 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.259435    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e34a2f991dc217"]
Oct 30 11:10:57.292193 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.292163    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"]
Oct 30 11:10:57.297379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.297358    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e34a2daeff068a"]
Oct 30 11:10:57.320171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.320145    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"]
Oct 30 11:10:57.327170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.327149    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e34a2cb8219136"]
Oct 30 11:10:57.351817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.351794    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"]
Oct 30 11:10:57.353627 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.353607    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-wrong-role-denied-18e34a29e0c4b55f"]
Oct 30 11:10:57.379464 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.379416    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"]
Oct 30 11:10:57.386850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.386828    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-role-only-denied-18e34a2709ca73ad"]
Oct 30 11:10:57.409809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.409785    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"]
Oct 30 11:10:57.416115 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.416094    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-part-only-denied-18e34a2431e1d35a"]
Oct 30 11:10:57.437992 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.437967    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"]
Oct 30 11:10:57.443990 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.443960    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-unlabeled-denied-18e34a20e2d070ab"]
Oct 30 11:10:57.467937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.467916    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"]
Oct 30 11:10:57.472847 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.472829    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-inferenceservice-allowed-18e34a1fec036675"]
Oct 30 11:10:57.494864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.494843    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"]
Oct 30 11:10:57.499241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.499223    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-scheduler-allowed-18e34a1ef5544df5"]
Oct 30 11:10:57.522375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.522333    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"]
Oct 30 11:10:57.523546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.523527    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-prefill-allowed-18e34a1dfdfec2f6"]
Oct 30 11:10:57.545890 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.545868    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"]
Oct 30 11:10:57.548912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.548892    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-prefill-allowed-18e34a1d074fb8a8"]
Oct 30 11:10:57.571603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.571579    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"]
Oct 30 11:10:57.574694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.574675    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-leader-allowed-18e34a1c89a2b235"]
Oct 30 11:10:57.599457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.599437    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"]
Oct 30 11:10:57.600966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.600951    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-worker-allowed-18e34a1c0b1eb0ee"]
Oct 30 11:10:57.628489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.628461    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"]
Oct 30 11:10:57.634548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.634493    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-prefill-allowed-18e34a1b8d6eff9c"]
Oct 30 11:10:57.658921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.658898    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"]
Oct 30 11:10:57.664640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.664621    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e349f61b3868cb/collector-otlp-workload-allowed-18e34a1b0eda36dd"]
Oct 30 11:10:57.686854 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.686831    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"]
Oct 30 11:10:57.696627 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.696599    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e34a17bdcd510a"]
Oct 30 11:10:57.719352 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.719322    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"]
Oct 30 11:10:57.723996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.723978    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e34a146e93df61"]
Oct 30 11:10:57.747778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.747757    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"]
Oct 30 11:10:57.749044 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.749023    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e34a111e84f302"]
Oct 30 11:10:57.770037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.770020    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"]
Oct 30 11:10:57.775443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.775426    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e34a0e46c9294b"]
Oct 30 11:10:57.803111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.803089    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d1abc5e-48ea-496d-9070-e5761375d2e7" path="/var/lib/kubelet/pods/0d1abc5e-48ea-496d-9070-e5761375d2e7/volumes"
Oct 30 11:10:57.803336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.803324    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1180afe6-27b5-4532-b1ce-d0e023e3c59b" path="/var/lib/kubelet/pods/1180afe6-27b5-4532-b1ce-d0e023e3c59b/volumes"
Oct 30 11:10:57.803549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.803536    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24a4a98e-9590-430c-862c-1a9d38664134" path="/var/lib/kubelet/pods/24a4a98e-9590-430c-862c-1a9d38664134/volumes"
Oct 30 11:10:57.803736 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.803722    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2965d86d-bc7a-4c88-b7d3-3407529e3a16" path="/var/lib/kubelet/pods/2965d86d-bc7a-4c88-b7d3-3407529e3a16/volumes"
Oct 30 11:10:57.803940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.803927    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504" path="/var/lib/kubelet/pods/2d4c0b10-c79c-4f1b-8d51-1ff1c70b7504/volumes"
Oct 30 11:10:57.804583 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.804568    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d9fc11c-0009-45b4-9f93-b3224fafd59b" path="/var/lib/kubelet/pods/2d9fc11c-0009-45b4-9f93-b3224fafd59b/volumes"
Oct 30 11:10:57.804773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.804762    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="375a7dfd-11ea-47c3-a823-bce222f9c268" path="/var/lib/kubelet/pods/375a7dfd-11ea-47c3-a823-bce222f9c268/volumes"
Oct 30 11:10:57.804957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.804946    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cc90c69-1011-4b39-bff4-e547b8ef28ad" path="/var/lib/kubelet/pods/3cc90c69-1011-4b39-bff4-e547b8ef28ad/volumes"
Oct 30 11:10:57.805130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.805120    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cef6ac9-c106-4018-a1f6-44c453845535" path="/var/lib/kubelet/pods/3cef6ac9-c106-4018-a1f6-44c453845535/volumes"
Oct 30 11:10:57.805312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.805301    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49b38901-6035-4061-bab4-c5f56fe94868" path="/var/lib/kubelet/pods/49b38901-6035-4061-bab4-c5f56fe94868/volumes"
Oct 30 11:10:57.805828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.805813    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a4b21f8-ff6a-4d25-aa74-de55f4cf9957" path="/var/lib/kubelet/pods/5a4b21f8-ff6a-4d25-aa74-de55f4cf9957/volumes"
Oct 30 11:10:57.806013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.806002    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87599215-376a-4acf-b91b-a1fb8057bff1" path="/var/lib/kubelet/pods/87599215-376a-4acf-b91b-a1fb8057bff1/volumes"
Oct 30 11:10:57.806191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.806181    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ade78639-d53c-4420-a77d-bb35fcb1ab90" path="/var/lib/kubelet/pods/ade78639-d53c-4420-a77d-bb35fcb1ab90/volumes"
Oct 30 11:10:57.806400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.806388    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2efcf6d-86f8-4146-90f6-94e1009a4de9" path="/var/lib/kubelet/pods/b2efcf6d-86f8-4146-90f6-94e1009a4de9/volumes"
Oct 30 11:10:57.806574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.806564    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9d247b1-0744-4431-a5d9-1f85cd0b8521" path="/var/lib/kubelet/pods/b9d247b1-0744-4431-a5d9-1f85cd0b8521/volumes"
Oct 30 11:10:57.807037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.807024    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9ce9508-1531-4324-a694-2605e97afdfe" path="/var/lib/kubelet/pods/d9ce9508-1531-4324-a694-2605e97afdfe/volumes"
Oct 30 11:10:57.807255 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.807245    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db3d7328-cdd1-4a9e-af76-9b179fe76b4f" path="/var/lib/kubelet/pods/db3d7328-cdd1-4a9e-af76-9b179fe76b4f/volumes"
Oct 30 11:10:57.807482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.807471    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0386d91-5d78-4ef6-8271-c073e7f13a3c" path="/var/lib/kubelet/pods/e0386d91-5d78-4ef6-8271-c073e7f13a3c/volumes"
Oct 30 11:10:57.807655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.807645    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e24cf90d-4335-4562-b6f7-0bba903cf07f" path="/var/lib/kubelet/pods/e24cf90d-4335-4562-b6f7-0bba903cf07f/volumes"
Oct 30 11:10:57.808076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.808063    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efdd69bc-7619-4808-9c68-d47dc3bed06e" path="/var/lib/kubelet/pods/efdd69bc-7619-4808-9c68-d47dc3bed06e/volumes"
Oct 30 11:10:57.808267 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.808256    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"]
Oct 30 11:10:57.808353 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.808279    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e34a0b6f03d025"]
Oct 30 11:10:57.822048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.822030    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"]
Oct 30 11:10:57.827411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.827394    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e34a08973be60e"]
Oct 30 11:10:57.850420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.850395    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"]
Oct 30 11:10:57.854936 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.854918    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e34a0547589122"]
Oct 30 11:10:57.882035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.882014    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"]
Oct 30 11:10:57.883806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.883788    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e34a01f772ea09"]
Oct 30 11:10:57.904925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.904878    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"]
Oct 30 11:10:57.911223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.911203    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e349fea799abf8"]
Oct 30 11:10:57.933751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.933734    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"]
Oct 30 11:10:57.938656 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.938638    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e349fbcfc84b2b"]
Oct 30 11:10:57.960457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.960436    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"]
Oct 30 11:10:57.965859 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.965842    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e349f8f7ff6496"]
Oct 30 11:10:57.994871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:57.994851    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"]
Oct 30 11:10:58.000166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:58.000148    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e349f61d3c1d88"]
Oct 30 11:10:58.093900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:58.089868    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"]
Oct 30 11:10:58.103914 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:58.103888    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e349f15c67e7ea"]
Oct 30 11:10:59.215774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.215744    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"]
Oct 30 11:10:59.216139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.216052    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e24cf90d-4335-4562-b6f7-0bba903cf07f" containerName="curl"
Oct 30 11:10:59.216139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.216063    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e24cf90d-4335-4562-b6f7-0bba903cf07f" containerName="curl"
Oct 30 11:10:59.216139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.216120    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e24cf90d-4335-4562-b6f7-0bba903cf07f" containerName="curl"
Oct 30 11:10:59.220261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.220244    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"
Oct 30 11:10:59.244418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.244398    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"]
Oct 30 11:10:59.257429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.257404    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e34a32aa6c2ba7\"/\"default-dockercfg-8gglp\""
Oct 30 11:10:59.261039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.261017    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"
Oct 30 11:10:59.558413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.558328    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"]
Oct 30 11:10:59.562161 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:10:59.562123    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e3910b8_ddd1_4278_b27c_1f2c124e8d61.slice/crio-81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89 WatchSource:0}: Error finding container 81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89: Status 404 returned error can't find the container with id 81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89
Oct 30 11:10:59.802931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.802900    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="062012c8-919d-43ed-98e7-77c58c9fd94c" path="/var/lib/kubelet/pods/062012c8-919d-43ed-98e7-77c58c9fd94c/volumes"
Oct 30 11:10:59.803138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.803126    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="076f7a47-7465-4160-a212-a2dc90088fc5" path="/var/lib/kubelet/pods/076f7a47-7465-4160-a212-a2dc90088fc5/volumes"
Oct 30 11:10:59.803325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.803314    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54338821-30da-4c4e-b0ca-ae7d0247433f" path="/var/lib/kubelet/pods/54338821-30da-4c4e-b0ca-ae7d0247433f/volumes"
Oct 30 11:10:59.803523 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.803512    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62b10050-b140-4dfe-a2b5-e81a07533094" path="/var/lib/kubelet/pods/62b10050-b140-4dfe-a2b5-e81a07533094/volumes"
Oct 30 11:10:59.803726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.803714    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73d7c8e6-64f6-448c-bcea-ab948cc4c540" path="/var/lib/kubelet/pods/73d7c8e6-64f6-448c-bcea-ab948cc4c540/volumes"
Oct 30 11:10:59.804221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.804208    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a249d4c2-32b3-4311-b2cc-d4d9786c629a" path="/var/lib/kubelet/pods/a249d4c2-32b3-4311-b2cc-d4d9786c629a/volumes"
Oct 30 11:10:59.804456 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.804432    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6ad01e9-0b2f-41aa-8fc8-e62733308809" path="/var/lib/kubelet/pods/b6ad01e9-0b2f-41aa-8fc8-e62733308809/volumes"
Oct 30 11:10:59.804646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.804634    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c215b220-058e-4489-b623-ecdbeff2d977" path="/var/lib/kubelet/pods/c215b220-058e-4489-b623-ecdbeff2d977/volumes"
Oct 30 11:10:59.804837 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:10:59.804826    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec03618b-c8d2-4ca1-a7da-0738fd3b970b" path="/var/lib/kubelet/pods/ec03618b-c8d2-4ca1-a7da-0738fd3b970b/volumes"
Oct 30 11:11:00.120329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.120296    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd" event={"ID":"6e3910b8-ddd1-4278-b27c-1f2c124e8d61","Type":"ContainerStarted","Data":"1ed839dc86701dc8969cba383dcb436450357229bcb7c15cd606e389533d047b"}
Oct 30 11:11:00.120498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.120357    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd" event={"ID":"6e3910b8-ddd1-4278-b27c-1f2c124e8d61","Type":"ContainerStarted","Data":"81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89"}
Oct 30 11:11:00.164861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.164799    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd" podStartSLOduration=1.164785408 podStartE2EDuration="1.164785408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:00.164352581 +0000 UTC m=+1556.509944426" watchObservedRunningTime="2026-10-30 11:11:00.164785408 +0000 UTC m=+1556.510377259"
Oct 30 11:11:00.519598 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.519563    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:00.524049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.524033    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.553283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.553258    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:00.671862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.671836    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrtp\" (UniqueName: \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.672004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.671872    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.672004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.671982    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.773220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.773146    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.773220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.773186    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrtp\" (UniqueName: \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.773220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.773210    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.773878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.773852    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.775481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.775465    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.799827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.799800    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrtp\" (UniqueName: \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\") pod \"data-science-collector-targetallocator-77f66b5f6b-xchh9\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:00.835471 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:00.835449    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:01.134360 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:01.134296    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:01.136504 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:01.136477    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae45b1c4_a0e6_4f77_a4cf_fd771f5e1ec2.slice/crio-235258c72efeeaf07f230d30de6732cc83224101710032d6a007158adcbc60ce WatchSource:0}: Error finding container 235258c72efeeaf07f230d30de6732cc83224101710032d6a007158adcbc60ce: Status 404 returned error can't find the container with id 235258c72efeeaf07f230d30de6732cc83224101710032d6a007158adcbc60ce
Oct 30 11:11:01.138606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:01.138568    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:01.138675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:01.138643    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:01.478090 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:01.478051    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:11:02.131212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.131177    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" event={"ID":"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2","Type":"ContainerStarted","Data":"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"}
Oct 30 11:11:02.131720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.131221    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" event={"ID":"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2","Type":"ContainerStarted","Data":"235258c72efeeaf07f230d30de6732cc83224101710032d6a007158adcbc60ce"}
Oct 30 11:11:02.131720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.131334    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:02.133112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.133087    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:02.230612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.230572    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" podStartSLOduration=2.230560195 podStartE2EDuration="2.230560195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:02.185278533 +0000 UTC m=+1558.530870386" watchObservedRunningTime="2026-10-30 11:11:02.230560195 +0000 UTC m=+1558.576152042"
Oct 30 11:11:02.265063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.265038    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:11:02.265229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.265194    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" podUID="8d16585d-436d-42fb-a35d-e5354932e2e7" containerName="ta-container" containerID="cri-o://b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8" gracePeriod=30
Oct 30 11:11:02.496368 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.496332    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:11:02.587603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.587576    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\" (UniqueName: \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\") pod \"8d16585d-436d-42fb-a35d-e5354932e2e7\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") "
Oct 30 11:11:02.587772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.587621    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\") pod \"8d16585d-436d-42fb-a35d-e5354932e2e7\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") "
Oct 30 11:11:02.587772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.587673    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\") pod \"8d16585d-436d-42fb-a35d-e5354932e2e7\" (UID: \"8d16585d-436d-42fb-a35d-e5354932e2e7\") "
Oct 30 11:11:02.588128 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.588101    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal" pod "8d16585d-436d-42fb-a35d-e5354932e2e7" (UID: "8d16585d-436d-42fb-a35d-e5354932e2e7"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:11:02.589711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.589684    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert" pod "8d16585d-436d-42fb-a35d-e5354932e2e7" (UID: "8d16585d-436d-42fb-a35d-e5354932e2e7"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:11:02.589711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.589702    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx" pod "8d16585d-436d-42fb-a35d-e5354932e2e7" (UID: "8d16585d-436d-42fb-a35d-e5354932e2e7"). InnerVolumeSpecName "kube-api-access-9r2zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:02.688557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.688536    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r2zx\" (UniqueName: \"kubernetes.io/projected/8d16585d-436d-42fb-a35d-e5354932e2e7-kube-api-access-9r2zx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:02.688557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.688557    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d16585d-436d-42fb-a35d-e5354932e2e7-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:02.688690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:02.688568    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d16585d-436d-42fb-a35d-e5354932e2e7-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:03.137054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.136973    4488 generic.go:356] "Generic (PLEG): container finished" podID="8d16585d-436d-42fb-a35d-e5354932e2e7" containerID="b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8" exitCode=0
Oct 30 11:11:03.137054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.137026    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"
Oct 30 11:11:03.137533 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.137054    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" event={"ID":"8d16585d-436d-42fb-a35d-e5354932e2e7","Type":"ContainerDied","Data":"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"}
Oct 30 11:11:03.137533 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.137099    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv" event={"ID":"8d16585d-436d-42fb-a35d-e5354932e2e7","Type":"ContainerDied","Data":"286e143968fef2b4f6f4103c31f31bea6bb1a3e88c875a90dd2f278e3fb15597"}
Oct 30 11:11:03.137533 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.137117    4488 scope.go:122] "RemoveContainer" containerID="b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"
Oct 30 11:11:03.148869 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.148815    4488 scope.go:122] "RemoveContainer" containerID="b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"
Oct 30 11:11:03.149257 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:03.149232    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8\": container with ID starting with b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8 not found: ID does not exist" containerID="b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"
Oct 30 11:11:03.149657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.149262    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8"} err="failed to get container status \"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8\": rpc error: code = NotFound desc = could not find container \"b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8\": container with ID starting with b664852eb40d3af23f17e70b3f8bbeb7b3b192549cd1befb01c902a9177fefc8 not found: ID does not exist"
Oct 30 11:11:03.197508 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.197478    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:11:03.198848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.198826    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dff6955b5-c22mv"]
Oct 30 11:11:03.802314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:03.802285    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d16585d-436d-42fb-a35d-e5354932e2e7" path="/var/lib/kubelet/pods/8d16585d-436d-42fb-a35d-e5354932e2e7/volumes"
Oct 30 11:11:10.171818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:10.171784    4488 generic.go:356] "Generic (PLEG): container finished" podID="6e3910b8-ddd1-4278-b27c-1f2c124e8d61" containerID="1ed839dc86701dc8969cba383dcb436450357229bcb7c15cd606e389533d047b" exitCode=0
Oct 30 11:11:10.172270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:10.171860    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd" event={"ID":"6e3910b8-ddd1-4278-b27c-1f2c124e8d61","Type":"ContainerDied","Data":"1ed839dc86701dc8969cba383dcb436450357229bcb7c15cd606e389533d047b"}
Oct 30 11:11:11.300639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:11.300617    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"
Oct 30 11:11:12.182150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:12.182125    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"
Oct 30 11:11:12.182150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:12.182145    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd" event={"ID":"6e3910b8-ddd1-4278-b27c-1f2c124e8d61","Type":"ContainerDied","Data":"81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89"}
Oct 30 11:11:12.182388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:12.182179    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81b6d4bd5a2ba8a7368aa308eca03d2d7abc703d70cba6483e877371a3397d89"
Oct 30 11:11:13.672733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.672700    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"]
Oct 30 11:11:13.673102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673002    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8d16585d-436d-42fb-a35d-e5354932e2e7" containerName="ta-container"
Oct 30 11:11:13.673102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673013    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d16585d-436d-42fb-a35d-e5354932e2e7" containerName="ta-container"
Oct 30 11:11:13.673102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673040    4488 cpu_manager.go:414] "containerMap: removing container" podUID="6e3910b8-ddd1-4278-b27c-1f2c124e8d61" containerName="curl"
Oct 30 11:11:13.673102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673046    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e3910b8-ddd1-4278-b27c-1f2c124e8d61" containerName="curl"
Oct 30 11:11:13.673102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673097    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d16585d-436d-42fb-a35d-e5354932e2e7" containerName="ta-container"
Oct 30 11:11:13.673263 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.673109    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e3910b8-ddd1-4278-b27c-1f2c124e8d61" containerName="curl"
Oct 30 11:11:13.675964 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.675947    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"
Oct 30 11:11:13.691966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.691944    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"]
Oct 30 11:11:13.693619 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.693600    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e34a32aa6c2ba7\"/\"default-dockercfg-8gglp\""
Oct 30 11:11:13.696714 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.696690    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"
Oct 30 11:11:13.998322 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:13.998240    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"]
Oct 30 11:11:14.000832 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:14.000807    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac366d76_1554_4a88_84f2_fa579e9672f1.slice/crio-7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af WatchSource:0}: Error finding container 7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af: Status 404 returned error can't find the container with id 7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af
Oct 30 11:11:14.192921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:14.192893    4488 generic.go:356] "Generic (PLEG): container finished" podID="ac366d76-1554-4a88-84f2-fa579e9672f1" containerID="a891efbd18249e6b185540217c449505222177803fd96494ec907ecb9ef83191" exitCode=0
Oct 30 11:11:14.193038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:14.192981    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd" event={"ID":"ac366d76-1554-4a88-84f2-fa579e9672f1","Type":"ContainerDied","Data":"a891efbd18249e6b185540217c449505222177803fd96494ec907ecb9ef83191"}
Oct 30 11:11:14.193038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:14.193018    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd" event={"ID":"ac366d76-1554-4a88-84f2-fa579e9672f1","Type":"ContainerStarted","Data":"7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af"}
Oct 30 11:11:15.321254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.321232    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"
Oct 30 11:11:15.991287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.991257    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"]
Oct 30 11:11:15.991557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.991544    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ac366d76-1554-4a88-84f2-fa579e9672f1" containerName="curl"
Oct 30 11:11:15.991602 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.991558    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac366d76-1554-4a88-84f2-fa579e9672f1" containerName="curl"
Oct 30 11:11:15.991641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.991624    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac366d76-1554-4a88-84f2-fa579e9672f1" containerName="curl"
Oct 30 11:11:15.994495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:15.994478    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"
Oct 30 11:11:16.004716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.004699    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"
Oct 30 11:11:16.011653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.011634    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"]
Oct 30 11:11:16.204174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.204117    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"
Oct 30 11:11:16.204174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.204147    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd" event={"ID":"ac366d76-1554-4a88-84f2-fa579e9672f1","Type":"ContainerDied","Data":"7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af"}
Oct 30 11:11:16.204366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.204176    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c50d81460fef38036ed94188bb8644a5495c42822b496a72225f34baaf7a7af"
Oct 30 11:11:16.301949 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:16.301928    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"]
Oct 30 11:11:16.304306 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:16.304281    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a462153_4a36_404d_8a25_f8787d295535.slice/crio-e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6 WatchSource:0}: Error finding container e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6: Status 404 returned error can't find the container with id e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6
Oct 30 11:11:17.210579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:17.210548    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122" event={"ID":"1a462153-4a36-404d-8a25-f8787d295535","Type":"ContainerStarted","Data":"b5923d5c40138e1ed2fcb0e60e784063f06192972681df6bcbbc4c03bce6b24d"}
Oct 30 11:11:17.210579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:17.210592    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122" event={"ID":"1a462153-4a36-404d-8a25-f8787d295535","Type":"ContainerStarted","Data":"e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6"}
Oct 30 11:11:17.253751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:17.253707    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122" podStartSLOduration=2.253692672 podStartE2EDuration="2.253692672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:17.252392518 +0000 UTC m=+1573.597984371" watchObservedRunningTime="2026-10-30 11:11:17.253692672 +0000 UTC m=+1573.599284527"
Oct 30 11:11:27.258264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:27.258232    4488 generic.go:356] "Generic (PLEG): container finished" podID="1a462153-4a36-404d-8a25-f8787d295535" containerID="b5923d5c40138e1ed2fcb0e60e784063f06192972681df6bcbbc4c03bce6b24d" exitCode=0
Oct 30 11:11:27.258667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:27.258317    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122" event={"ID":"1a462153-4a36-404d-8a25-f8787d295535","Type":"ContainerDied","Data":"b5923d5c40138e1ed2fcb0e60e784063f06192972681df6bcbbc4c03bce6b24d"}
Oct 30 11:11:28.386077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:28.386053    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"
Oct 30 11:11:29.269521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:29.269488    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"
Oct 30 11:11:29.269694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:29.269493    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122" event={"ID":"1a462153-4a36-404d-8a25-f8787d295535","Type":"ContainerDied","Data":"e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6"}
Oct 30 11:11:29.269694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:29.269613    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e77b65b167cce75e9e4a97c4ad576d3e380cadac699b5b505fff8d5ab36ebce6"
Oct 30 11:11:30.145757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.145726    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"]
Oct 30 11:11:30.151300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.151277    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/revoked-inference-denied-18e34a36cfea2122"]
Oct 30 11:11:30.172245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.172224    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"]
Oct 30 11:11:30.178840 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.178820    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/enrolled-inference-allowed-18e34a3643904fbd"]
Oct 30 11:11:30.199770 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.199745    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"]
Oct 30 11:11:30.204331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:30.204311    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e34a32aa6c2ba7/unenrolled-spoof-denied-18e34a32e6e3e3fd"]
Oct 30 11:11:31.477148 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:31.477113    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:11:31.805632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:31.803308    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a462153-4a36-404d-8a25-f8787d295535" path="/var/lib/kubelet/pods/1a462153-4a36-404d-8a25-f8787d295535/volumes"
Oct 30 11:11:31.805632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:31.803711    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e3910b8-ddd1-4278-b27c-1f2c124e8d61" path="/var/lib/kubelet/pods/6e3910b8-ddd1-4278-b27c-1f2c124e8d61/volumes"
Oct 30 11:11:31.805632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:31.804033    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac366d76-1554-4a88-84f2-fa579e9672f1" path="/var/lib/kubelet/pods/ac366d76-1554-4a88-84f2-fa579e9672f1/volumes"
Oct 30 11:11:32.426427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.426391    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:32.426754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.426736    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1a462153-4a36-404d-8a25-f8787d295535" containerName="curl"
Oct 30 11:11:32.426799 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.426756    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a462153-4a36-404d-8a25-f8787d295535" containerName="curl"
Oct 30 11:11:32.426834 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.426827    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a462153-4a36-404d-8a25-f8787d295535" containerName="curl"
Oct 30 11:11:32.429781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.429766    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.461904 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.461878    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:32.488591 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.488563    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdt2k\" (UniqueName: \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.488902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.488611    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.488902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.488692    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.589307 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.589282    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdt2k\" (UniqueName: \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.589430 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.589327    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.589430 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.589368    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.589921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.589899    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.591849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.591823    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.613818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.613792    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdt2k\" (UniqueName: \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\") pod \"data-science-collector-targetallocator-748cfdddf6-ls5sp\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:32.740916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:32.740862    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:33.038851 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.038779    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:33.041761 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:33.041726    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a03b384_27c4_4909_8b3f_30efb4778c35.slice/crio-240108307dbbd4466a381f11e5da62bb28b4b8a767f1876a4a5bf84da34f4d19 WatchSource:0}: Error finding container 240108307dbbd4466a381f11e5da62bb28b4b8a767f1876a4a5bf84da34f4d19: Status 404 returned error can't find the container with id 240108307dbbd4466a381f11e5da62bb28b4b8a767f1876a4a5bf84da34f4d19
Oct 30 11:11:33.044028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.043995    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:33.044109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.044055    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:33.291217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.291128    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" event={"ID":"9a03b384-27c4-4909-8b3f-30efb4778c35","Type":"ContainerStarted","Data":"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"}
Oct 30 11:11:33.291217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.291166    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" event={"ID":"9a03b384-27c4-4909-8b3f-30efb4778c35","Type":"ContainerStarted","Data":"240108307dbbd4466a381f11e5da62bb28b4b8a767f1876a4a5bf84da34f4d19"}
Oct 30 11:11:33.291494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.291276    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:33.292418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.292391    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.96:8080/readyz\": dial tcp 10.133.0.96:8080: connect: connection refused"
Oct 30 11:11:33.337119 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.337078    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" podStartSLOduration=1.337067321 podStartE2EDuration="1.337067321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:33.335776962 +0000 UTC m=+1589.681368816" watchObservedRunningTime="2026-10-30 11:11:33.337067321 +0000 UTC m=+1589.682659175"
Oct 30 11:11:33.947433 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.947383    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 11:11:33.947793 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.947579    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" podUID="c1d061e4-c52e-4840-912e-5723e05c689e" containerName="thanos-querier" containerID="cri-o://ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45" gracePeriod=30
Oct 30 11:11:33.986850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.986823    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"]
Oct 30 11:11:33.990633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:33.990610    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.000743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.000705    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrw6\" (UniqueName: \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9\" (UID: \"eff4e228-bf20-42fe-9a1b-c3715d5226f6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.007256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.007206    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"]
Oct 30 11:11:34.019549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.019527    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"]
Oct 30 11:11:34.019756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:34.019736    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-llrw6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9" podUID="eff4e228-bf20-42fe-9a1b-c3715d5226f6"
Oct 30 11:11:34.101986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.101602    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llrw6\" (UniqueName: \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9\" (UID: \"eff4e228-bf20-42fe-9a1b-c3715d5226f6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.131147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.131081    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrw6\" (UniqueName: \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9\" (UID: \"eff4e228-bf20-42fe-9a1b-c3715d5226f6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.206325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.206248    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 11:11:34.296527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296496    4488 generic.go:356] "Generic (PLEG): container finished" podID="c1d061e4-c52e-4840-912e-5723e05c689e" containerID="ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45" exitCode=0
Oct 30 11:11:34.296699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296538    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"
Oct 30 11:11:34.296699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296582    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" event={"ID":"c1d061e4-c52e-4840-912e-5723e05c689e","Type":"ContainerDied","Data":"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"}
Oct 30 11:11:34.296699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296627    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847" event={"ID":"c1d061e4-c52e-4840-912e-5723e05c689e","Type":"ContainerDied","Data":"f1d747c44d91c27b9514f167bb4ad409803f71064f4247fcc7ff4b9a23fe0ff2"}
Oct 30 11:11:34.296699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296658    4488 scope.go:122] "RemoveContainer" containerID="ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"
Oct 30 11:11:34.296906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.296868    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.297642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.297623    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:34.302803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.302774    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\" (UniqueName: \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\") pod \"c1d061e4-c52e-4840-912e-5723e05c689e\" (UID: \"c1d061e4-c52e-4840-912e-5723e05c689e\") "
Oct 30 11:11:34.303601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.303583    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:34.304901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.304874    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4" pod "c1d061e4-c52e-4840-912e-5723e05c689e" (UID: "c1d061e4-c52e-4840-912e-5723e05c689e"). InnerVolumeSpecName "kube-api-access-r22s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:34.305715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.305699    4488 scope.go:122] "RemoveContainer" containerID="ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"
Oct 30 11:11:34.306029 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:34.305994    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45\": container with ID starting with ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45 not found: ID does not exist" containerID="ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"
Oct 30 11:11:34.306097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.306040    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45"} err="failed to get container status \"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45\": rpc error: code = NotFound desc = could not find container \"ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45\": container with ID starting with ef8aadb1045707f751e5cd3b4503a485818b27c4602d7d27870040e87e6ece45 not found: ID does not exist"
Oct 30 11:11:34.393472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.393444    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:34.393625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.393586    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" podUID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" containerName="ta-container" containerID="cri-o://e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db" gracePeriod=30
Oct 30 11:11:34.403369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.403320    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\" (UniqueName: \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\") pod \"eff4e228-bf20-42fe-9a1b-c3715d5226f6\" (UID: \"eff4e228-bf20-42fe-9a1b-c3715d5226f6\") "
Oct 30 11:11:34.403611 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.403586    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r22s4\" (UniqueName: \"kubernetes.io/projected/c1d061e4-c52e-4840-912e-5723e05c689e-kube-api-access-r22s4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:34.405397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.405373    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6" pod "eff4e228-bf20-42fe-9a1b-c3715d5226f6" (UID: "eff4e228-bf20-42fe-9a1b-c3715d5226f6"). InnerVolumeSpecName "kube-api-access-llrw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:34.504223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.504165    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llrw6\" (UniqueName: \"kubernetes.io/projected/eff4e228-bf20-42fe-9a1b-c3715d5226f6-kube-api-access-llrw6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:34.635423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.635401    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:34.644050 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.644025    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 11:11:34.649460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.649437    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4n847"]
Oct 30 11:11:34.705192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.705165    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\") pod \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") "
Oct 30 11:11:34.705365 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.705241    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\") pod \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") "
Oct 30 11:11:34.705365 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.705296    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\" (UniqueName: \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\") pod \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\" (UID: \"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2\") "
Oct 30 11:11:34.705690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.705668    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal" pod "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" (UID: "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:11:34.707420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.707381    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert" pod "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" (UID: "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:11:34.707668 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.707635    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp" pod "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" (UID: "ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2"). InnerVolumeSpecName "kube-api-access-2jrtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:34.806827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.806743    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:34.806827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.806770    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrtp\" (UniqueName: \"kubernetes.io/projected/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-kube-api-access-2jrtp\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:34.806827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.806781    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:34.898687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.898649    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:34.927815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.927787    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:34.928016 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:34.927968    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="f3d857cb-273f-425d-8bc2-806925823430" containerName="perses" containerID="cri-o://32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd" gracePeriod=30
Oct 30 11:11:35.171816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.171791    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:35.209731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.209700    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\" (UniqueName: \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\") pod \"f3d857cb-273f-425d-8bc2-806925823430\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") "
Oct 30 11:11:35.209944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.209750    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\" (UniqueName: \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\") pod \"f3d857cb-273f-425d-8bc2-806925823430\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") "
Oct 30 11:11:35.209944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.209901    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"f3d857cb-273f-425d-8bc2-806925823430\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") "
Oct 30 11:11:35.210081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.209966    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\") pod \"f3d857cb-273f-425d-8bc2-806925823430\" (UID: \"f3d857cb-273f-425d-8bc2-806925823430\") "
Oct 30 11:11:35.210196 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.210120    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config" pod "f3d857cb-273f-425d-8bc2-806925823430" (UID: "f3d857cb-273f-425d-8bc2-806925823430"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:11:35.210554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.210467    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3d857cb-273f-425d-8bc2-806925823430-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:35.212411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.212373    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g" pod "f3d857cb-273f-425d-8bc2-806925823430" (UID: "f3d857cb-273f-425d-8bc2-806925823430"). InnerVolumeSpecName "kube-api-access-92m9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:35.213390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.213366    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "f3d857cb-273f-425d-8bc2-806925823430" (UID: "f3d857cb-273f-425d-8bc2-806925823430"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:11:35.303154 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.303120    4488 generic.go:356] "Generic (PLEG): container finished" podID="f3d857cb-273f-425d-8bc2-806925823430" containerID="32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd" exitCode=0
Oct 30 11:11:35.303311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.303166    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:35.303311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.303211    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f3d857cb-273f-425d-8bc2-806925823430","Type":"ContainerDied","Data":"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"}
Oct 30 11:11:35.303311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.303256    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f3d857cb-273f-425d-8bc2-806925823430","Type":"ContainerDied","Data":"9dc009b9b8d0cea369e0b4f63d68695bd4b336afb98b7cc0afe3a8de96a4f07f"}
Oct 30 11:11:35.303311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.303279    4488 scope.go:122] "RemoveContainer" containerID="32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"
Oct 30 11:11:35.304552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.304528    4488 generic.go:356] "Generic (PLEG): container finished" podID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" containerID="e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db" exitCode=0
Oct 30 11:11:35.304724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.304582    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"
Oct 30 11:11:35.304724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.304615    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" event={"ID":"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2","Type":"ContainerDied","Data":"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"}
Oct 30 11:11:35.304724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.304651    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9" event={"ID":"ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2","Type":"ContainerDied","Data":"235258c72efeeaf07f230d30de6732cc83224101710032d6a007158adcbc60ce"}
Oct 30 11:11:35.305830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.305810    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"
Oct 30 11:11:35.311682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.311656    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92m9g\" (UniqueName: \"kubernetes.io/projected/f3d857cb-273f-425d-8bc2-806925823430-kube-api-access-92m9g\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:35.311872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.311713    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:11:35.314762 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.314419    4488 scope.go:122] "RemoveContainer" containerID="32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"
Oct 30 11:11:35.314871 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.314764    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd\": container with ID starting with 32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd not found: ID does not exist" containerID="32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"
Oct 30 11:11:35.314871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.314806    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd"} err="failed to get container status \"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd\": rpc error: code = NotFound desc = could not find container \"32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd\": container with ID starting with 32ce5956f216b86fc6583da0873901f3109aadb88d6e27af6da2e1cad95d6dfd not found: ID does not exist"
Oct 30 11:11:35.314871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.314830    4488 scope.go:122] "RemoveContainer" containerID="e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"
Oct 30 11:11:35.325502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.325485    4488 scope.go:122] "RemoveContainer" containerID="e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"
Oct 30 11:11:35.325811 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.325788    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db\": container with ID starting with e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db not found: ID does not exist" containerID="e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"
Oct 30 11:11:35.325882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.325820    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db"} err="failed to get container status \"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db\": rpc error: code = NotFound desc = could not find container \"e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db\": container with ID starting with e2c41fa79ae10e846260e589168b0995205e908967c8f6b4f074723fb05e50db not found: ID does not exist"
Oct 30 11:11:35.326149 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.326133    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:11:35.363171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.363121    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins" pod "f3d857cb-273f-425d-8bc2-806925823430" (UID: "f3d857cb-273f-425d-8bc2-806925823430"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:11:35.392014 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.391989    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"]
Oct 30 11:11:35.394086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.394067    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-cqwg9"]
Oct 30 11:11:35.413003 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.412978    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:11:35.413077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.413005    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f3d857cb-273f-425d-8bc2-806925823430-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:35.413077 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.413030    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-targetallocator: configmap "data-science-collector-targetallocator" not found
Oct 30 11:11:35.413160 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.413094    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal podName:9a03b384-27c4-4909-8b3f-30efb4778c35 nodeName:}" failed. No retries permitted until 2026-10-30 11:11:35.913077365 +0000 UTC m=+1592.258669226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ta-internal" (UniqueName: "kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal") pod "data-science-collector-targetallocator-748cfdddf6-ls5sp" (UID: "9a03b384-27c4-4909-8b3f-30efb4778c35") : configmap "data-science-collector-targetallocator" not found
Oct 30 11:11:35.431622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.431600    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:35.436445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.436426    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77f66b5f6b-xchh9"]
Oct 30 11:11:35.655221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.655162    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:35.657579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.657555    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:35.802997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.802965    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" path="/var/lib/kubelet/pods/ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2/volumes"
Oct 30 11:11:35.803401 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.803380    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1d061e4-c52e-4840-912e-5723e05c689e" path="/var/lib/kubelet/pods/c1d061e4-c52e-4840-912e-5723e05c689e/volumes"
Oct 30 11:11:35.803753 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.803736    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eff4e228-bf20-42fe-9a1b-c3715d5226f6" path="/var/lib/kubelet/pods/eff4e228-bf20-42fe-9a1b-c3715d5226f6/volumes"
Oct 30 11:11:35.804056 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:35.804040    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3d857cb-273f-425d-8bc2-806925823430" path="/var/lib/kubelet/pods/f3d857cb-273f-425d-8bc2-806925823430/volumes"
Oct 30 11:11:35.916326 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.916255    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-targetallocator: configmap "data-science-collector-targetallocator" not found
Oct 30 11:11:35.916326 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:35.916318    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal podName:9a03b384-27c4-4909-8b3f-30efb4778c35 nodeName:}" failed. No retries permitted until 2026-10-30 11:11:36.916303481 +0000 UTC m=+1593.261895316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ta-internal" (UniqueName: "kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal") pod "data-science-collector-targetallocator-748cfdddf6-ls5sp" (UID: "9a03b384-27c4-4909-8b3f-30efb4778c35") : configmap "data-science-collector-targetallocator" not found
Oct 30 11:11:36.316232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.316198    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerName="ta-container" containerID="cri-o://2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775" gracePeriod=30
Oct 30 11:11:36.556766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.556741    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:36.621596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.621527    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\") pod \"9a03b384-27c4-4909-8b3f-30efb4778c35\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") "
Oct 30 11:11:36.621596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.621590    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\" (UniqueName: \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\") pod \"9a03b384-27c4-4909-8b3f-30efb4778c35\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") "
Oct 30 11:11:36.621794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.621662    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\") pod \"9a03b384-27c4-4909-8b3f-30efb4778c35\" (UID: \"9a03b384-27c4-4909-8b3f-30efb4778c35\") "
Oct 30 11:11:36.621996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.621974    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal" pod "9a03b384-27c4-4909-8b3f-30efb4778c35" (UID: "9a03b384-27c4-4909-8b3f-30efb4778c35"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:11:36.623704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.623676    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert" pod "9a03b384-27c4-4909-8b3f-30efb4778c35" (UID: "9a03b384-27c4-4909-8b3f-30efb4778c35"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:11:36.623704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.623696    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k" pod "9a03b384-27c4-4909-8b3f-30efb4778c35" (UID: "9a03b384-27c4-4909-8b3f-30efb4778c35"). InnerVolumeSpecName "kube-api-access-vdt2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:11:36.722552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.722529    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdt2k\" (UniqueName: \"kubernetes.io/projected/9a03b384-27c4-4909-8b3f-30efb4778c35-kube-api-access-vdt2k\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:36.722552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.722550    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9a03b384-27c4-4909-8b3f-30efb4778c35-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:36.722686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:36.722560    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9a03b384-27c4-4909-8b3f-30efb4778c35-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:11:37.322118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.322083    4488 generic.go:356] "Generic (PLEG): container finished" podID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerID="2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775" exitCode=0
Oct 30 11:11:37.322643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.322129    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" event={"ID":"9a03b384-27c4-4909-8b3f-30efb4778c35","Type":"ContainerDied","Data":"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"}
Oct 30 11:11:37.322643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.322141    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"
Oct 30 11:11:37.322643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.322156    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp" event={"ID":"9a03b384-27c4-4909-8b3f-30efb4778c35","Type":"ContainerDied","Data":"240108307dbbd4466a381f11e5da62bb28b4b8a767f1876a4a5bf84da34f4d19"}
Oct 30 11:11:37.322643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.322172    4488 scope.go:122] "RemoveContainer" containerID="2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"
Oct 30 11:11:37.331926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.331908    4488 scope.go:122] "RemoveContainer" containerID="2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"
Oct 30 11:11:37.332193 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:11:37.332174    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775\": container with ID starting with 2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775 not found: ID does not exist" containerID="2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"
Oct 30 11:11:37.332239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.332201    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775"} err="failed to get container status \"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775\": rpc error: code = NotFound desc = could not find container \"2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775\": container with ID starting with 2c176bb3e78ac7eddaf2eeddccdd344b22acb6b6b30dcba965684fa87858e775 not found: ID does not exist"
Oct 30 11:11:37.377772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.377750    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:37.382004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.381983    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748cfdddf6-ls5sp"]
Oct 30 11:11:37.806924 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:37.802588    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" path="/var/lib/kubelet/pods/9a03b384-27c4-4909-8b3f-30efb4778c35/volumes"
Oct 30 11:11:38.800114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800084    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800409    4488 cpu_manager.go:414] "containerMap: removing container" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerName="ta-container"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800422    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerName="ta-container"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800432    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f3d857cb-273f-425d-8bc2-806925823430" containerName="perses"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800438    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3d857cb-273f-425d-8bc2-806925823430" containerName="perses"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800447    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" containerName="ta-container"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800452    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" containerName="ta-container"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800475    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c1d061e4-c52e-4840-912e-5723e05c689e" containerName="thanos-querier"
Oct 30 11:11:38.800504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800481    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1d061e4-c52e-4840-912e-5723e05c689e" containerName="thanos-querier"
Oct 30 11:11:38.800757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800539    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a03b384-27c4-4909-8b3f-30efb4778c35" containerName="ta-container"
Oct 30 11:11:38.800757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800547    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3d857cb-273f-425d-8bc2-806925823430" containerName="perses"
Oct 30 11:11:38.800757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800553    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae45b1c4-a0e6-4f77-a4cf-fd771f5e1ec2" containerName="ta-container"
Oct 30 11:11:38.800757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.800559    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1d061e4-c52e-4840-912e-5723e05c689e" containerName="thanos-querier"
Oct 30 11:11:38.804822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.804803    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:38.818061 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.818038    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:38.821287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.821266    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:38.822503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.822479    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:11:38.838623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.838601    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:38.850899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.850880    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:11:38.850899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.850882    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8vgtc\""
Oct 30 11:11:38.851024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.850884    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:11:38.893567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.893548    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:11:38.893567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.893551    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:11:38.893709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.893576    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:11:38.893709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.893704    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-61f7caf9\""
Oct 30 11:11:38.937546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937524    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:38.937640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937556    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwsp\" (UniqueName: \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:38.937640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937583    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:38.937747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937728    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:38.937795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937759    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:38.937795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:38.937780    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjlcv\" (UniqueName: \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.038944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.038922    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.039033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.038952    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwsp\" (UniqueName: \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.039033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.038982    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.039033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039015    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.039033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039032    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.039216 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039051    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjlcv\" (UniqueName: \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.039366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039321    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.039689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039672    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.039745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.039677    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.041485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.041464    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.064191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.064142    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwsp\" (UniqueName: \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:39.064191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.064183    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjlcv\" (UniqueName: \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\") pod \"data-science-collector-collector-1\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.117392 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.117333    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:11:39.419039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.419010    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:11:39.422655 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:39.422618    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b36e884_de5a_458e_aef7_1ad4ef7c8aa4.slice/crio-3b84da3b41d3aa4cf5354a9f906e9881af6cf88dd89f24446a084fb5c4660448 WatchSource:0}: Error finding container 3b84da3b41d3aa4cf5354a9f906e9881af6cf88dd89f24446a084fb5c4660448: Status 404 returned error can't find the container with id 3b84da3b41d3aa4cf5354a9f906e9881af6cf88dd89f24446a084fb5c4660448
Oct 30 11:11:39.425126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.425099    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:39.425200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:39.425150    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:11:40.340623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:40.340586    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4","Type":"ContainerStarted","Data":"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"}
Oct 30 11:11:40.341009 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:40.340635    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4","Type":"ContainerStarted","Data":"3b84da3b41d3aa4cf5354a9f906e9881af6cf88dd89f24446a084fb5c4660448"}
Oct 30 11:11:40.385601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:40.385550    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.385538527 podStartE2EDuration="2.385538527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:40.385071749 +0000 UTC m=+1596.730663604" watchObservedRunningTime="2026-10-30 11:11:40.385538527 +0000 UTC m=+1596.731130458"
Oct 30 11:11:44.181193 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.181161    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.228410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.228381    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.282421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.282395    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.282549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.282532    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.298894 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.298869    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.402821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.402794    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.435529 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.435478    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.534864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.534838    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:44.831837 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:44.831813    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:11:44.834460 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:11:44.834434    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf910055_92ed_4c34_b229_816bf694bd59.slice/crio-e82276599eb271efe132e177199930ae7c26b2992963fcc17fbf6f16c029f9cd WatchSource:0}: Error finding container e82276599eb271efe132e177199930ae7c26b2992963fcc17fbf6f16c029f9cd: Status 404 returned error can't find the container with id e82276599eb271efe132e177199930ae7c26b2992963fcc17fbf6f16c029f9cd
Oct 30 11:11:45.365968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:45.365932    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"bf910055-92ed-4c34-b229-816bf694bd59","Type":"ContainerStarted","Data":"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"}
Oct 30 11:11:45.365968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:45.365974    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"bf910055-92ed-4c34-b229-816bf694bd59","Type":"ContainerStarted","Data":"e82276599eb271efe132e177199930ae7c26b2992963fcc17fbf6f16c029f9cd"}
Oct 30 11:11:45.366409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:45.366069    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:11:45.410982 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:45.410930    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=7.410918612 podStartE2EDuration="7.410918612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:11:45.410038778 +0000 UTC m=+1601.755630650" watchObservedRunningTime="2026-10-30 11:11:45.410918612 +0000 UTC m=+1601.756510505"
Oct 30 11:11:56.373684 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:11:56.373654    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:01.477705 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:01.477668    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:12:31.477773 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:31.477734    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:12:32.556446 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.556407    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:12:32.556817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.556662    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" containerName="otc-container" containerID="cri-o://b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619" gracePeriod=30
Oct 30 11:12:32.707441 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.706733    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:32.707441 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.706936    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="bf910055-92ed-4c34-b229-816bf694bd59" containerName="perses" containerID="cri-o://215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5" gracePeriod=30
Oct 30 11:12:32.829381 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.829332    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:12:32.919957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.919929    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\") pod \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") "
Oct 30 11:12:32.920133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.919996    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\") pod \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") "
Oct 30 11:12:32.920133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.920040    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\" (UniqueName: \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\") pod \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\" (UID: \"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4\") "
Oct 30 11:12:32.920462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.920428    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal" pod "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" (UID: "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:32.921938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.921910    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs" pod "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" (UID: "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:12:32.922036 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.921997    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv" pod "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" (UID: "7b36e884-de5a-458e-aef7-1ad4ef7c8aa4"). InnerVolumeSpecName "kube-api-access-xjlcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:12:32.935317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:32.935293    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:33.021110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021080    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\" (UniqueName: \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\") pod \"bf910055-92ed-4c34-b229-816bf694bd59\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") "
Oct 30 11:12:33.021282 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021207    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"bf910055-92ed-4c34-b229-816bf694bd59\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") "
Oct 30 11:12:33.021367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021282    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\") pod \"bf910055-92ed-4c34-b229-816bf694bd59\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") "
Oct 30 11:12:33.021367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021324    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\" (UniqueName: \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\") pod \"bf910055-92ed-4c34-b229-816bf694bd59\" (UID: \"bf910055-92ed-4c34-b229-816bf694bd59\") "
Oct 30 11:12:33.021862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021621    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.021862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021645    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjlcv\" (UniqueName: \"kubernetes.io/projected/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-kube-api-access-xjlcv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.021862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021659    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.021862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.021733    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config" pod "bf910055-92ed-4c34-b229-816bf694bd59" (UID: "bf910055-92ed-4c34-b229-816bf694bd59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:33.024084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.024064    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp" pod "bf910055-92ed-4c34-b229-816bf694bd59" (UID: "bf910055-92ed-4c34-b229-816bf694bd59"). InnerVolumeSpecName "kube-api-access-gzwsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:12:33.027841 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.027824    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "bf910055-92ed-4c34-b229-816bf694bd59" (UID: "bf910055-92ed-4c34-b229-816bf694bd59"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:12:33.122717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.122647    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:12:33.122717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.122677    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf910055-92ed-4c34-b229-816bf694bd59-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.122717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.122689    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzwsp\" (UniqueName: \"kubernetes.io/projected/bf910055-92ed-4c34-b229-816bf694bd59-kube-api-access-gzwsp\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.135609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.135591    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:12:33.173959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.173929    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins" pod "bf910055-92ed-4c34-b229-816bf694bd59" (UID: "bf910055-92ed-4c34-b229-816bf694bd59"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:12:33.223681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.223661    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/bf910055-92ed-4c34-b229-816bf694bd59-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:33.223681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.223680    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:12:33.600599 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.600564    4488 generic.go:356] "Generic (PLEG): container finished" podID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" containerID="b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619" exitCode=0
Oct 30 11:12:33.600951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.600610    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:12:33.600951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.600652    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4","Type":"ContainerDied","Data":"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"}
Oct 30 11:12:33.600951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.600714    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"7b36e884-de5a-458e-aef7-1ad4ef7c8aa4","Type":"ContainerDied","Data":"3b84da3b41d3aa4cf5354a9f906e9881af6cf88dd89f24446a084fb5c4660448"}
Oct 30 11:12:33.600951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.600749    4488 scope.go:122] "RemoveContainer" containerID="b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"
Oct 30 11:12:33.602192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.602170    4488 generic.go:356] "Generic (PLEG): container finished" podID="bf910055-92ed-4c34-b229-816bf694bd59" containerID="215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5" exitCode=0
Oct 30 11:12:33.602273 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.602197    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:33.602273 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.602214    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"bf910055-92ed-4c34-b229-816bf694bd59","Type":"ContainerDied","Data":"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"}
Oct 30 11:12:33.602273 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.602244    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"bf910055-92ed-4c34-b229-816bf694bd59","Type":"ContainerDied","Data":"e82276599eb271efe132e177199930ae7c26b2992963fcc17fbf6f16c029f9cd"}
Oct 30 11:12:33.613258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.613126    4488 scope.go:122] "RemoveContainer" containerID="b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"
Oct 30 11:12:33.613464 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:33.613437    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619\": container with ID starting with b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619 not found: ID does not exist" containerID="b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"
Oct 30 11:12:33.613555 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.613472    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619"} err="failed to get container status \"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619\": rpc error: code = NotFound desc = could not find container \"b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619\": container with ID starting with b50b69f7d260a5e4e8b300a1c97ff82e684b5d47a623a07e9d4c2a8cbcd70619 not found: ID does not exist"
Oct 30 11:12:33.613555 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.613494    4488 scope.go:122] "RemoveContainer" containerID="215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"
Oct 30 11:12:33.621376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.621361    4488 scope.go:122] "RemoveContainer" containerID="215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"
Oct 30 11:12:33.621648 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:33.621630    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5\": container with ID starting with 215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5 not found: ID does not exist" containerID="215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"
Oct 30 11:12:33.621693 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.621655    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5"} err="failed to get container status \"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5\": rpc error: code = NotFound desc = could not find container \"215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5\": container with ID starting with 215276f97854c061a5fbc615a0ca0d8c08445eca7c1c6effbecaff1ae38247d5 not found: ID does not exist"
Oct 30 11:12:33.655749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.655726    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:33.669732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.669711    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:33.704074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.700362    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:12:33.704880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.704863    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:12:33.802295 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.802262    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" path="/var/lib/kubelet/pods/7b36e884-de5a-458e-aef7-1ad4ef7c8aa4/volumes"
Oct 30 11:12:33.802674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:33.802662    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf910055-92ed-4c34-b229-816bf694bd59" path="/var/lib/kubelet/pods/bf910055-92ed-4c34-b229-816bf694bd59/volumes"
Oct 30 11:12:35.814798 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.814766    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815027    4488 cpu_manager.go:414] "containerMap: removing container" podUID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" containerName="otc-container"
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815037    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" containerName="otc-container"
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815063    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bf910055-92ed-4c34-b229-816bf694bd59" containerName="perses"
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815088    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf910055-92ed-4c34-b229-816bf694bd59" containerName="perses"
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815138    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf910055-92ed-4c34-b229-816bf694bd59" containerName="perses"
Oct 30 11:12:35.815174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.815147    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b36e884-de5a-458e-aef7-1ad4ef7c8aa4" containerName="otc-container"
Oct 30 11:12:35.838005 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.837974    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:35.838166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.838076    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:35.884137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.884105    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:12:35.888087 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.888070    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:12:35.888181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.888128    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:12:35.888181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:35.888176    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:12:36.048190 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.048164    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.048287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.048196    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.048287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.048231    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xvn8\" (UniqueName: \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.149298 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.149228    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.149298 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.149265    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.149298 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.149292    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvn8\" (UniqueName: \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.149647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.149628    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.149900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.149881    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.174123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.174100    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvn8\" (UniqueName: \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:36.604496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.604464    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:36.608350 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.608321    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.624733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.624703    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-ca-bundle\""
Oct 30 11:12:36.624853 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.624837    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-serving-cabundle\""
Oct 30 11:12:36.626235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.626216    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway-serving-cert\""
Oct 30 11:12:36.639069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.639034    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-tvjpt\""
Oct 30 11:12:36.639069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.639038    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:12:36.639069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.639045    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:12:36.639247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.639058    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-mtls\""
Oct 30 11:12:36.639247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.639114    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-config\""
Oct 30 11:12:36.641421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.641405    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:36.752507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752482    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752531    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752553    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s95w\" (UniqueName: \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752657    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752720    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752739    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752757    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.752835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.752774    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853573 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853550    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853579    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s95w\" (UniqueName: \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853597    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853809    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853850    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853879    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.853946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853906    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.854260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.853975    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.854449 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.854421    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.854663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.854611    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.854759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.854662    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.854759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.854673    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.856114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.856096    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.856571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.856554    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.856677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.856656    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:36.878331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:36.878302    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s95w\" (UniqueName: \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:45.615963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.615931    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.648167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.648137    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.716470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.716443    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.716576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.716536    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.732791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.732769    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.835161 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.835136    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:45.865855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:45.865830    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:46.049858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.049831    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:46.346368 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.346251    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:46.349392 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:12:46.349337    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode966bd7f_ec6b_4b5a_bbcf_272ba3b687fe.slice/crio-88c4a7c5f4bac4eb7c22cea757a12d591023967294a7d65d94aaef79d3171df9 WatchSource:0}: Error finding container 88c4a7c5f4bac4eb7c22cea757a12d591023967294a7d65d94aaef79d3171df9: Status 404 returned error can't find the container with id 88c4a7c5f4bac4eb7c22cea757a12d591023967294a7d65d94aaef79d3171df9
Oct 30 11:12:46.422331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.422307    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.454968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.454940    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.523465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.523427    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.523636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.523574    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.539870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.539838    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.645078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.645039    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fd3ed81014d76a975b5ba6f044c00684e55bfb3daddf6ff0e225ceff74c57792/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.669702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.669672    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe","Type":"ContainerStarted","Data":"e66c1e53b1aa69fccbedaeaca493904edc6a3c8471c1f207d563024283cda572"}
Oct 30 11:12:46.669861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.669718    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe","Type":"ContainerStarted","Data":"88c4a7c5f4bac4eb7c22cea757a12d591023967294a7d65d94aaef79d3171df9"}
Oct 30 11:12:46.669861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.669819    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:46.675535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.675512    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:46.718031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.717966    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=11.717948353 podStartE2EDuration="11.717948353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:12:46.717508469 +0000 UTC m=+1663.063100324" watchObservedRunningTime="2026-10-30 11:12:46.717948353 +0000 UTC m=+1663.063540207"
Oct 30 11:12:46.826684 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:46.826654    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:47.163571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:47.163541    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:47.166695 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:12:47.166642    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7334a84_aace_49d2_963d_b74308d716a2.slice/crio-70dd52b327b3f4f6f2211981b32f111b185ec5a0b6486330fc5d4dfc3e50d4e8 WatchSource:0}: Error finding container 70dd52b327b3f4f6f2211981b32f111b185ec5a0b6486330fc5d4dfc3e50d4e8: Status 404 returned error can't find the container with id 70dd52b327b3f4f6f2211981b32f111b185ec5a0b6486330fc5d4dfc3e50d4e8
Oct 30 11:12:47.169420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:47.169398    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 11:12:47.676713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:47.676680    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerStarted","Data":"70dd52b327b3f4f6f2211981b32f111b185ec5a0b6486330fc5d4dfc3e50d4e8"}
Oct 30 11:12:49.699408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:49.699381    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerStarted","Data":"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"}
Oct 30 11:12:51.518551 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.518513    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:51.518996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.518720    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" containerName="perses" containerID="cri-o://e66c1e53b1aa69fccbedaeaca493904edc6a3c8471c1f207d563024283cda572" gracePeriod=30
Oct 30 11:12:51.713292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.713255    4488 generic.go:356] "Generic (PLEG): container finished" podID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" containerID="e66c1e53b1aa69fccbedaeaca493904edc6a3c8471c1f207d563024283cda572" exitCode=0
Oct 30 11:12:51.713485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.713329    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe","Type":"ContainerDied","Data":"e66c1e53b1aa69fccbedaeaca493904edc6a3c8471c1f207d563024283cda572"}
Oct 30 11:12:51.809113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.809087    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:51.822004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.821974    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:51.869779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.869753    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") "
Oct 30 11:12:51.869900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.869801    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\" (UniqueName: \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\") pod \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") "
Oct 30 11:12:51.869900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.869823    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\") pod \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") "
Oct 30 11:12:51.869900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.869874    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\" (UniqueName: \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\") pod \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\" (UID: \"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe\") "
Oct 30 11:12:51.870381 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.870332    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config" pod "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" (UID: "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:51.872086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.872055    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8" pod "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" (UID: "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe"). InnerVolumeSpecName "kube-api-access-5xvn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:12:51.872797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.872772    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" (UID: "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:12:51.970507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.970481    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xvn8\" (UniqueName: \"kubernetes.io/projected/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-kube-api-access-5xvn8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:51.970630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.970509    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:51.970630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.970548    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:12:51.982557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:51.982533    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:12:52.015930 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.015902    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins" pod "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" (UID: "e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:12:52.071363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.071293    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:12:52.071363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.071316    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:52.720960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.720927    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerStarted","Data":"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"}
Oct 30 11:12:52.722246 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.722220    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:52.722390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.722264    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe","Type":"ContainerDied","Data":"88c4a7c5f4bac4eb7c22cea757a12d591023967294a7d65d94aaef79d3171df9"}
Oct 30 11:12:52.722390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.722316    4488 scope.go:122] "RemoveContainer" containerID="e66c1e53b1aa69fccbedaeaca493904edc6a3c8471c1f207d563024283cda572"
Oct 30 11:12:52.778427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.778393    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:52.782385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:52.782364    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:53.803801 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:53.803757    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" path="/var/lib/kubelet/pods/e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe/volumes"
Oct 30 11:12:54.610648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.610578    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:54.610870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.610857    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" containerName="perses"
Oct 30 11:12:54.610919 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.610871    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" containerName="perses"
Oct 30 11:12:54.610955 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.610936    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e966bd7f-ec6b-4b5a-bbcf-272ba3b687fe" containerName="perses"
Oct 30 11:12:54.613967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.613936    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.634396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.634369    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:54.689123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.689101    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:12:54.689123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.689101    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:12:54.736499 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736463    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerStarted","Data":"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"}
Oct 30 11:12:54.736628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736499    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo" containerID="cri-o://6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75" gracePeriod=30
Oct 30 11:12:54.736628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736531    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway-opa" containerID="cri-o://bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816" gracePeriod=30
Oct 30 11:12:54.736628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736557    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway" containerID="cri-o://e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c" gracePeriod=30
Oct 30 11:12:54.736628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736533    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:54.736824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736641    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:54.736824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.736708    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:54.741028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.740975    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:54.742383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.742357    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:12:54.786854 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.786815    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podStartSLOduration=11.901722484 podStartE2EDuration="18.786801107s" totalImagesPullingTime="6.885078623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:12:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:12:54.786714298 +0000 UTC m=+1671.132306153" watchObservedRunningTime="2026-10-30 11:12:54.786801107 +0000 UTC m=+1671.132392962"
Oct 30 11:12:54.790754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.790728    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.790868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.790777    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.790868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.790795    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcs6g\" (UniqueName: \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.891653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.891631    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.891968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.891681    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.891968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.891699    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcs6g\" (UniqueName: \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.892040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.891974    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.892221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.892204    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:54.920039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:54.920013    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcs6g\" (UniqueName: \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:55.065882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.065861    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:55.194030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194006    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194040    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194060    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194119    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194191    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194217    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\" (UniqueName: \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194234    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194262    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194333    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\") pod \"f7334a84-aace-49d2-963d-b74308d716a2\" (UID: \"f7334a84-aace-49d2-963d-b74308d716a2\") "
Oct 30 11:12:55.194574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194384    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:55.194574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194408    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:55.194752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194724    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.194836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194750    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.194836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194792    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "gateway-rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:55.194836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.194805    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-serving-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:12:55.196549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.196519    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-gateway-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:12:55.196667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.196617    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "kube-api-access-5s95w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:12:55.196802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.196783    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "gateway-tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:12:55.196865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.196814    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:12:55.197311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.197293    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e" pod "f7334a84-aace-49d2-963d-b74308d716a2" (UID: "f7334a84-aace-49d2-963d-b74308d716a2"). InnerVolumeSpecName "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:12:55.295103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295080    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-gateway-serving-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295116    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295128    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s95w\" (UniqueName: \"kubernetes.io/projected/f7334a84-aace-49d2-963d-b74308d716a2-kube-api-access-5s95w\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295136    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-gateway-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295145    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-serving-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295154    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-gateway-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.295207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.295163    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/f7334a84-aace-49d2-963d-b74308d716a2-tempo-data-science-tempomonolithic-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:12:55.303678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.303664    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:12:55.396002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.395975    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\""
Oct 30 11:12:55.743973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.743934    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7334a84-aace-49d2-963d-b74308d716a2" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816" exitCode=0
Oct 30 11:12:55.743973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.743966    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7334a84-aace-49d2-963d-b74308d716a2" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c" exitCode=0
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.743979    4488 generic.go:356] "Generic (PLEG): container finished" podID="f7334a84-aace-49d2-963d-b74308d716a2" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75" exitCode=0
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.743999    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.744015    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerDied","Data":"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"}
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.744079    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerDied","Data":"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"}
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.744106    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerDied","Data":"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"}
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.744129    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"f7334a84-aace-49d2-963d-b74308d716a2","Type":"ContainerDied","Data":"70dd52b327b3f4f6f2211981b32f111b185ec5a0b6486330fc5d4dfc3e50d4e8"}
Oct 30 11:12:55.744187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.744149    4488 scope.go:122] "RemoveContainer" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"
Oct 30 11:12:55.754973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.754925    4488 scope.go:122] "RemoveContainer" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"
Oct 30 11:12:55.763401 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.763383    4488 scope.go:122] "RemoveContainer" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"
Oct 30 11:12:55.772227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.772199    4488 scope.go:122] "RemoveContainer" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"
Oct 30 11:12:55.772616 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:55.772594    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": container with ID starting with bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816 not found: ID does not exist" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"
Oct 30 11:12:55.772721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.772622    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"} err="failed to get container status \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": rpc error: code = NotFound desc = could not find container \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": container with ID starting with bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816 not found: ID does not exist"
Oct 30 11:12:55.772721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.772655    4488 scope.go:122] "RemoveContainer" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"
Oct 30 11:12:55.773070 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:55.773049    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": container with ID starting with e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c not found: ID does not exist" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"
Oct 30 11:12:55.773147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773074    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"} err="failed to get container status \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": rpc error: code = NotFound desc = could not find container \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": container with ID starting with e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c not found: ID does not exist"
Oct 30 11:12:55.773147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773091    4488 scope.go:122] "RemoveContainer" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"
Oct 30 11:12:55.773414 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:12:55.773390    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": container with ID starting with 6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75 not found: ID does not exist" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"
Oct 30 11:12:55.773485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773421    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"} err="failed to get container status \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": rpc error: code = NotFound desc = could not find container \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": container with ID starting with 6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75 not found: ID does not exist"
Oct 30 11:12:55.773485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773441    4488 scope.go:122] "RemoveContainer" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"
Oct 30 11:12:55.773657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773638    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"} err="failed to get container status \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": rpc error: code = NotFound desc = could not find container \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": container with ID starting with bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816 not found: ID does not exist"
Oct 30 11:12:55.773732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773657    4488 scope.go:122] "RemoveContainer" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"
Oct 30 11:12:55.773907 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773888    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"} err="failed to get container status \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": rpc error: code = NotFound desc = could not find container \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": container with ID starting with e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c not found: ID does not exist"
Oct 30 11:12:55.773974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.773906    4488 scope.go:122] "RemoveContainer" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"
Oct 30 11:12:55.774168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774139    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"} err="failed to get container status \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": rpc error: code = NotFound desc = could not find container \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": container with ID starting with 6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75 not found: ID does not exist"
Oct 30 11:12:55.774255 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774170    4488 scope.go:122] "RemoveContainer" containerID="bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"
Oct 30 11:12:55.774491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774472    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816"} err="failed to get container status \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": rpc error: code = NotFound desc = could not find container \"bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816\": container with ID starting with bb709b12a2b3c70172f500ee852382dd5b4d26b6ce38b79caf0504c40f25c816 not found: ID does not exist"
Oct 30 11:12:55.774541 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774491    4488 scope.go:122] "RemoveContainer" containerID="e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"
Oct 30 11:12:55.774756 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774736    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c"} err="failed to get container status \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": rpc error: code = NotFound desc = could not find container \"e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c\": container with ID starting with e7496c35d0945f7f5d742a3b47aaf59a98be75223939599dd47b5cb771758a8c not found: ID does not exist"
Oct 30 11:12:55.774800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.774757    4488 scope.go:122] "RemoveContainer" containerID="6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"
Oct 30 11:12:55.775026 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.775005    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75"} err="failed to get container status \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": rpc error: code = NotFound desc = could not find container \"6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75\": container with ID starting with 6d2219d407ecbc8d471a95bdb0f213f1353af3f3be9e81beca4b900299059b75 not found: ID does not exist"
Oct 30 11:12:55.798565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.798544    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:55.801947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.801930    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:55.810591 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.810568    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:12:55.830913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.830891    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:55.899560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.899526    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:55.899920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.899680    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:55.918203 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:55.918178    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:56.018615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.018589    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:56.048805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.048784    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:56.125085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.125064    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:56.420692 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.420672    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:12:56.423416 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:12:56.423383    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod531a6d3d_ddbe_44ab_93aa_d59ab83f7341.slice/crio-6d16bbbfd16f1625122ba1d7b35a0cf574fd0a2e987c0ecb658660b206717572 WatchSource:0}: Error finding container 6d16bbbfd16f1625122ba1d7b35a0cf574fd0a2e987c0ecb658660b206717572: Status 404 returned error can't find the container with id 6d16bbbfd16f1625122ba1d7b35a0cf574fd0a2e987c0ecb658660b206717572
Oct 30 11:12:56.752639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.752557    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"531a6d3d-ddbe-44ab-93aa-d59ab83f7341","Type":"ContainerStarted","Data":"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"}
Oct 30 11:12:56.752639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.752597    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"531a6d3d-ddbe-44ab-93aa-d59ab83f7341","Type":"ContainerStarted","Data":"6d16bbbfd16f1625122ba1d7b35a0cf574fd0a2e987c0ecb658660b206717572"}
Oct 30 11:12:56.752836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.752676    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:12:56.796916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:56.796858    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=2.796844186 podStartE2EDuration="2.796844186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:12:56.795785027 +0000 UTC m=+1673.141376884" watchObservedRunningTime="2026-10-30 11:12:56.796844186 +0000 UTC m=+1673.142436037"
Oct 30 11:12:57.803792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:12:57.803757    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7334a84-aace-49d2-963d-b74308d716a2" path="/var/lib/kubelet/pods/f7334a84-aace-49d2-963d-b74308d716a2/volumes"
Oct 30 11:13:01.478106 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:13:01.478061    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:13:04.126140 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:04.126110    4488 scope.go:122] "RemoveContainer" containerID="58bef7fc2595435db75f92fdaacf4471dc114ddaaeb0f30e5efc45c5273a13d7"
Oct 30 11:13:04.134445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:04.134425    4488 scope.go:122] "RemoveContainer" containerID="1f4816e8dbde240a0923d9ad2bcfef7b651f6ebf25ea9aebba09878109844ae7"
Oct 30 11:13:04.141733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:04.141710    4488 scope.go:122] "RemoveContainer" containerID="470d20a960645b0335fab46115c8f9b340c4e82e35fc0cdbff28d0d336e1d3f7"
Oct 30 11:13:04.149004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:04.148987    4488 scope.go:122] "RemoveContainer" containerID="65e2639e5361807fcaabfd11f3bf1bd017528e1a9054114a404ba6d234144762"
Oct 30 11:13:07.761401 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:07.761365    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:13:31.477097 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:13:31.477062    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:13:50.740481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.740449    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:13:50.741157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.740645    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" containerName="perses" containerID="cri-o://93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6" gracePeriod=30
Oct 30 11:13:50.990792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.990736    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:13:50.997646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.997622    4488 generic.go:356] "Generic (PLEG): container finished" podID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" containerID="93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6" exitCode=0
Oct 30 11:13:50.997759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.997664    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:13:50.997759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.997710    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"531a6d3d-ddbe-44ab-93aa-d59ab83f7341","Type":"ContainerDied","Data":"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"}
Oct 30 11:13:50.997846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.997758    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"531a6d3d-ddbe-44ab-93aa-d59ab83f7341","Type":"ContainerDied","Data":"6d16bbbfd16f1625122ba1d7b35a0cf574fd0a2e987c0ecb658660b206717572"}
Oct 30 11:13:50.997846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:50.997779    4488 scope.go:122] "RemoveContainer" containerID="93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"
Oct 30 11:13:51.005649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.005626    4488 scope.go:122] "RemoveContainer" containerID="93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"
Oct 30 11:13:51.005933 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:13:51.005912    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6\": container with ID starting with 93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6 not found: ID does not exist" containerID="93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"
Oct 30 11:13:51.006024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.005942    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6"} err="failed to get container status \"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6\": rpc error: code = NotFound desc = could not find container \"93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6\": container with ID starting with 93da5ba5d2966bde0bf8a53b81e443277de78bd3c32ba37d92a34ce3843f23e6 not found: ID does not exist"
Oct 30 11:13:51.063763 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.063739    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\" (UniqueName: \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\") pod \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") "
Oct 30 11:13:51.063905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.063791    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\" (UniqueName: \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\") pod \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") "
Oct 30 11:13:51.063905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.063851    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\" (UniqueName: \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\") pod \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") "
Oct 30 11:13:51.064011 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.063950    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\" (UID: \"531a6d3d-ddbe-44ab-93aa-d59ab83f7341\") "
Oct 30 11:13:51.064217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.064194    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config" pod "531a6d3d-ddbe-44ab-93aa-d59ab83f7341" (UID: "531a6d3d-ddbe-44ab-93aa-d59ab83f7341"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:13:51.068245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.068218    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g" pod "531a6d3d-ddbe-44ab-93aa-d59ab83f7341" (UID: "531a6d3d-ddbe-44ab-93aa-d59ab83f7341"). InnerVolumeSpecName "kube-api-access-hcs6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:13:51.071289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.071266    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "531a6d3d-ddbe-44ab-93aa-d59ab83f7341" (UID: "531a6d3d-ddbe-44ab-93aa-d59ab83f7341"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:13:51.164698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.164670    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:13:51.164698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.164695    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcs6g\" (UniqueName: \"kubernetes.io/projected/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-kube-api-access-hcs6g\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:13:51.164698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.164706    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:13:51.177759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.177742    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:13:51.226184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.226153    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins" pod "531a6d3d-ddbe-44ab-93aa-d59ab83f7341" (UID: "531a6d3d-ddbe-44ab-93aa-d59ab83f7341"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:13:51.265986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.265937    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/531a6d3d-ddbe-44ab-93aa-d59ab83f7341-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:13:51.265986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.265961    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:13:51.349230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.349203    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:13:51.350639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.350620    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:13:51.803188 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:51.803156    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" path="/var/lib/kubelet/pods/531a6d3d-ddbe-44ab-93aa-d59ab83f7341/volumes"
Oct 30 11:13:54.291920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.291886    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292187    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway-opa"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292204    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway-opa"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292219    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292225    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292235    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292240    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292256    4488 cpu_manager.go:414] "containerMap: removing container" podUID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" containerName="perses"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292262    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" containerName="perses"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292331    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292355    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo"
Oct 30 11:13:54.292366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292367    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="531a6d3d-ddbe-44ab-93aa-d59ab83f7341" containerName="perses"
Oct 30 11:13:54.292752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.292376    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7334a84-aace-49d2-963d-b74308d716a2" containerName="tempo-gateway-opa"
Oct 30 11:13:54.315256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.315229    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:13:54.315449 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.315334    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.332618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.332598    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:13:54.332734 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.332629    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:13:54.346451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.346430    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:13:54.385907 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.385886    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcmcj\" (UniqueName: \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.386013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.385929    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.486480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.486456    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcmcj\" (UniqueName: \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.486575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.486498    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.486787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.486773    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.511510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.511490    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcmcj\" (UniqueName: \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\") pod \"seaweedfs\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.629880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.629821    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:13:54.926390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:54.926366    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:13:54.929048 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:13:54.929025    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67edf1e2_27d8_4184_a26f_c1bf742b7b6f.slice/crio-a9cfe8fe5c55fef7b3e2554d6428ae57e87eb4522f7c3985c9e100ff06cb1ba3 WatchSource:0}: Error finding container a9cfe8fe5c55fef7b3e2554d6428ae57e87eb4522f7c3985c9e100ff06cb1ba3: Status 404 returned error can't find the container with id a9cfe8fe5c55fef7b3e2554d6428ae57e87eb4522f7c3985c9e100ff06cb1ba3
Oct 30 11:13:55.018547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:13:55.018515    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"67edf1e2-27d8-4184-a26f-c1bf742b7b6f","Type":"ContainerStarted","Data":"a9cfe8fe5c55fef7b3e2554d6428ae57e87eb4522f7c3985c9e100ff06cb1ba3"}
Oct 30 11:14:00.047633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:00.047594    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"67edf1e2-27d8-4184-a26f-c1bf742b7b6f","Type":"ContainerStarted","Data":"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"}
Oct 30 11:14:00.048028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:00.047695    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:14:00.089858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:00.089806    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=1.394708986 podStartE2EDuration="6.089791348s" totalImagesPullingTime="4.695082362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:14:00.089572923 +0000 UTC m=+1736.435164777" watchObservedRunningTime="2026-10-30 11:14:00.089791348 +0000 UTC m=+1736.435383203"
Oct 30 11:14:01.477771 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:14:01.477736    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:14:04.189775 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:04.189745    4488 scope.go:122] "RemoveContainer" containerID="fa648d957b58df9ffde7c7e68922db26b104bfb08aec02c929e72e0f8bd7db73"
Oct 30 11:14:04.197980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:04.197963    4488 scope.go:122] "RemoveContainer" containerID="809c6c4b3c53c1476a6759bf8829b0b3b431c3203a551e2ef7c698bd0fdb97b6"
Oct 30 11:14:04.205155 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:04.205141    4488 scope.go:122] "RemoveContainer" containerID="e070d1bf861a81f8eed7431c40a54b3e9166ee111ad2fcbb62435c265981cb90"
Oct 30 11:14:04.212120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:04.212102    4488 scope.go:122] "RemoveContainer" containerID="ace77f9e206969e6e64cc2838d3d924cd4305eb109176a04907bed10981a7410"
Oct 30 11:14:11.054092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:11.054058    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:14:12.547726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.547697    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:14:12.552413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.552395    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:12.565396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.565373    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:14:12.610751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.610720    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj76m\" (UniqueName: \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\") pod \"seaweedfs-bucket-creator\" (UID: \"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:12.711150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.711128    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj76m\" (UniqueName: \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\") pod \"seaweedfs-bucket-creator\" (UID: \"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:12.736400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.736380    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj76m\" (UniqueName: \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\") pod \"seaweedfs-bucket-creator\" (UID: \"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:12.863746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:12.863687    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:13.158223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:13.158157    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:14:13.161109 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:14:13.161083    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d73e0d5_b4d8_4cfb_911a_9087b00ede4c.slice/crio-3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98 WatchSource:0}: Error finding container 3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98: Status 404 returned error can't find the container with id 3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98
Oct 30 11:14:14.113293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:14.113212    4488 generic.go:356] "Generic (PLEG): container finished" podID="1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" containerID="e0c004b7e12a1eced6d9f507dd49ecfa9b10491c9557222321728e4e6dfed67a" exitCode=0
Oct 30 11:14:14.113293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:14.113260    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c","Type":"ContainerDied","Data":"e0c004b7e12a1eced6d9f507dd49ecfa9b10491c9557222321728e4e6dfed67a"}
Oct 30 11:14:14.113293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:14.113287    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c","Type":"ContainerStarted","Data":"3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98"}
Oct 30 11:14:15.242858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:15.242832    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:15.331984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:15.331957    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\" (UniqueName: \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\") pod \"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c\" (UID: \"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c\") "
Oct 30 11:14:15.333905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:15.333875    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m" pod "1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" (UID: "1d73e0d5-b4d8-4cfb-911a-9087b00ede4c"). InnerVolumeSpecName "kube-api-access-xj76m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:14:15.433021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:15.432999    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj76m\" (UniqueName: \"kubernetes.io/projected/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c-kube-api-access-xj76m\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:14:16.123020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:16.122955    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:14:16.123144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:16.122949    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"1d73e0d5-b4d8-4cfb-911a-9087b00ede4c","Type":"ContainerDied","Data":"3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98"}
Oct 30 11:14:16.123144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:16.123077    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e82406c13c2d79108faf1a3bc540622e2f2c15bb4772d471c2de8c4d4319f98"
Oct 30 11:14:18.445855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.445823    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:14:18.446435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.446123    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" containerName="create-bucket"
Oct 30 11:14:18.446435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.446134    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" containerName="create-bucket"
Oct 30 11:14:18.446435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.446182    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" containerName="create-bucket"
Oct 30 11:14:18.449118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.449094    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.466643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.466618    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:14:18.479445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.479428    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:14:18.557216 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.557189    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.557320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.557247    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.557415 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.557353    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79jhl\" (UniqueName: \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.657887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.657858    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79jhl\" (UniqueName: \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.657978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.657906    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.657978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.657937    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.658253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.658238    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.658535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.658518    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:18.684768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:18.684744    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79jhl\" (UniqueName: \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:21.433333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.433301    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:14:21.436909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.436890    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.460535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.460510    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-ca-bundle\""
Oct 30 11:14:21.460666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.460563    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"s3-secret\""
Oct 30 11:14:21.462010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.461980    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:14:21.474427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.474402    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-dockercfg-fhk88\""
Oct 30 11:14:21.474559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.474451    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack\""
Oct 30 11:14:21.474715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.474695    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-query-frontend-mtls\""
Oct 30 11:14:21.477666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.477646    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mrb\" (UniqueName: \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.477733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.477685    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.477804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.477791    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.477841 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.477813    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.477841 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.477835    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.530524 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.530498    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:14:21.533906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.533890    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.554269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.554248    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:14:21.561438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.561395    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-compactor-mtls\""
Oct 30 11:14:21.578852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.578829    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mrb\" (UniqueName: \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.578965 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.578867    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.578965 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.578888    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.578965 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.578919    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.579123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579074    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.579196 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579136    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.579196 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579187    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5df9\" (UniqueName: \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.579309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579246    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.579309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579268    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.579546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579336    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.579983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.579957    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.580095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.580040    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.580487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.580455    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.582628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.582603    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.605030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.605010    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mrb\" (UniqueName: \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\") pod \"tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.680614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680595    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.680699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680622    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5df9\" (UniqueName: \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.680699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680680    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.680805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680699    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.680805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680723    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.680972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.680950    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.681297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.681276    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.681446 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.681428    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.683025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.683004    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.705994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.705943    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5df9\" (UniqueName: \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\") pod \"tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:21.751113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.751092    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:21.846151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:21.846127    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:22.063296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.063245    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:14:22.065382 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:14:22.065359    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cfd71a_d8c5_4e4b_9ea2_5e8c4400f98d.slice/crio-395259ef6ac35e3c5a8c94a6b6c4ac671282bd2821764546dce8c166a919cfe7 WatchSource:0}: Error finding container 395259ef6ac35e3c5a8c94a6b6c4ac671282bd2821764546dce8c166a919cfe7: Status 404 returned error can't find the container with id 395259ef6ac35e3c5a8c94a6b6c4ac671282bd2821764546dce8c166a919cfe7
Oct 30 11:14:22.148978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.148951    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" event={"ID":"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d","Type":"ContainerStarted","Data":"395259ef6ac35e3c5a8c94a6b6c4ac671282bd2821764546dce8c166a919cfe7"}
Oct 30 11:14:22.154236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.154214    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:14:22.156951 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:14:22.156923    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a570b2_d292_4b79_ba01_6f63b932e175.slice/crio-aba4069bc4335769cc7a792053e13a2cfc510b1ed3de49e2d7b79df97fcfaaf1 WatchSource:0}: Error finding container aba4069bc4335769cc7a792053e13a2cfc510b1ed3de49e2d7b79df97fcfaaf1: Status 404 returned error can't find the container with id aba4069bc4335769cc7a792053e13a2cfc510b1ed3de49e2d7b79df97fcfaaf1
Oct 30 11:14:22.229733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.229709    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:14:22.233073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.233059    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.252782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.252756    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 11:14:22.253007 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.252993    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-cabundle\""
Oct 30 11:14:22.253323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.253307    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 11:14:22.260323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.260303    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-mtls\""
Oct 30 11:14:22.266608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.266589    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-dockercfg-hnf5m\""
Oct 30 11:14:22.266910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.266887    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-tls\""
Oct 30 11:14:22.268284 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.268263    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284713    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284762    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284787    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284807    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284841    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c95c\" (UniqueName: \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284867    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.285414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.284919    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.385719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385652    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.385719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385702    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.385886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385811    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.385886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385837    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.385886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385863    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c95c\" (UniqueName: \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.386059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385889    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.386059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.385947    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.386572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.386548    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.386667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.386582    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.386667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.386611    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.388006 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.387986    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.388476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.388457    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.388566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.388510    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.411102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.411082    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c95c\" (UniqueName: \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\") pod \"tempo-data-science-tempostack-gateway-5fbddb975c-nj52k\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.547359 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.547308    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:22.973405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:22.973211    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:14:22.975760 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:14:22.975734    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc39d86a_99e0_4bd3_884c_e5bc42ab8cad.slice/crio-28e8d89b51b7d0f5e8beeee4f263929610c4d1fd10eb7e688715468d77db71ff WatchSource:0}: Error finding container 28e8d89b51b7d0f5e8beeee4f263929610c4d1fd10eb7e688715468d77db71ff: Status 404 returned error can't find the container with id 28e8d89b51b7d0f5e8beeee4f263929610c4d1fd10eb7e688715468d77db71ff
Oct 30 11:14:23.155492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.155466    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerStarted","Data":"47d019bf0f662df63937153d5d519f840bb4aaa160c1b1aed41a9b73b77a1c1e"}
Oct 30 11:14:23.155612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.155537    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerStarted","Data":"28e8d89b51b7d0f5e8beeee4f263929610c4d1fd10eb7e688715468d77db71ff"}
Oct 30 11:14:23.156970 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.156948    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" event={"ID":"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d","Type":"ContainerStarted","Data":"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"}
Oct 30 11:14:23.157086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.157029    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:23.158490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.158469    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" event={"ID":"a6a570b2-d292-4b79-ba01-6f63b932e175","Type":"ContainerStarted","Data":"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"}
Oct 30 11:14:23.158582 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.158504    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" event={"ID":"a6a570b2-d292-4b79-ba01-6f63b932e175","Type":"ContainerStarted","Data":"aba4069bc4335769cc7a792053e13a2cfc510b1ed3de49e2d7b79df97fcfaaf1"}
Oct 30 11:14:23.158625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.158590    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:14:23.203912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.203873    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" podStartSLOduration=2.203861381 podStartE2EDuration="2.203861381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:14:23.202490017 +0000 UTC m=+1759.548081872" watchObservedRunningTime="2026-10-30 11:14:23.203861381 +0000 UTC m=+1759.549453234"
Oct 30 11:14:23.248774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:23.248709    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podStartSLOduration=2.248699363 podStartE2EDuration="2.248699363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:14:23.247582496 +0000 UTC m=+1759.593174414" watchObservedRunningTime="2026-10-30 11:14:23.248699363 +0000 UTC m=+1759.594291216"
Oct 30 11:14:24.164870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.164832    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerStarted","Data":"94db7f7a8386a1770216409ab5c3e2856efc9efdaa526c845f7453bd2edb8bb5"}
Oct 30 11:14:24.165409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.165270    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:24.165409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.165320    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:24.166440 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.166410    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.108:8083/ready\": dial tcp 10.133.0.108:8083: connect: connection refused"
Oct 30 11:14:24.166440 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.166426    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway" probeResult="failure" output="Get \"https://10.133.0.108:8081/ready\": dial tcp 10.133.0.108:8081: connect: connection refused"
Oct 30 11:14:24.242385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:24.242313    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" podStartSLOduration=2.242297216 podStartE2EDuration="2.242297216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:14:24.227795977 +0000 UTC m=+1760.573387851" watchObservedRunningTime="2026-10-30 11:14:24.242297216 +0000 UTC m=+1760.587889067"
Oct 30 11:14:25.170705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:25.170676    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:25.191984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:25.191964    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:14:27.727286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.727256    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.760057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.760029    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.828596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.828570    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.828715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.828657    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.844836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.844812    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.947501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.947475    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:27.979973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:27.979918    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:28.060908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:28.060882    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:28.360788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:28.360711    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:14:28.363570 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:14:28.363543    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab631be2_a161_45c1_b339_852cb86a6123.slice/crio-40dd485bb404f9b718ee6c8ef5ef8537a79221ffb231388c396f3963b4425102 WatchSource:0}: Error finding container 40dd485bb404f9b718ee6c8ef5ef8537a79221ffb231388c396f3963b4425102: Status 404 returned error can't find the container with id 40dd485bb404f9b718ee6c8ef5ef8537a79221ffb231388c396f3963b4425102
Oct 30 11:14:29.189256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:29.189216    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ab631be2-a161-45c1-b339-852cb86a6123","Type":"ContainerStarted","Data":"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"}
Oct 30 11:14:29.189755 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:29.189367    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:29.189755 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:29.189401    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ab631be2-a161-45c1-b339-852cb86a6123","Type":"ContainerStarted","Data":"40dd485bb404f9b718ee6c8ef5ef8537a79221ffb231388c396f3963b4425102"}
Oct 30 11:14:29.233857 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:29.233811    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=11.233799325 podStartE2EDuration="11.233799325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:14:29.23338668 +0000 UTC m=+1765.578978559" watchObservedRunningTime="2026-10-30 11:14:29.233799325 +0000 UTC m=+1765.579391175"
Oct 30 11:14:31.477600 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:14:31.477561    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:14:40.197631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:40.197601    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:14:44.171086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:44.171044    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:14:44.291639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:44.291615    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:14:54.169724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:14:54.169688    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:01.477657 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:15:01.477611    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:15:04.169865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.169823    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:04.242634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.242605    4488 scope.go:122] "RemoveContainer" containerID="e6d0fdef53daa6459c3ef3ff40e2186c3bfbfcb1874332226eebc818feddd4a4"
Oct 30 11:15:04.250672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.250655    4488 scope.go:122] "RemoveContainer" containerID="7821b3328dacde5a45dc795fcfe37b6da18b56a7d1321ea783a602a511da9167"
Oct 30 11:15:04.257839 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.257821    4488 scope.go:122] "RemoveContainer" containerID="1d01958c6f6471d4b2d8db5fa433af8d73cc5aee011bdbac252b3876e158cedd"
Oct 30 11:15:04.265185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.265168    4488 scope.go:122] "RemoveContainer" containerID="53d6012cb66dc717d8faf8ed9466bd7be7914dca4cdd151f87b86aa40edb3b1f"
Oct 30 11:15:04.272176 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:04.272160    4488 scope.go:122] "RemoveContainer" containerID="d1bf1eb346df174822498a0d57044ed493941b572f5387ebac7af318d7602691"
Oct 30 11:15:14.170024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:14.169981    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:24.169960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:24.169931    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:15:31.478804 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:15:31.478770    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:15:31.853704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:31.853632    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:15:31.853905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:31.853800    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="ab631be2-a161-45c1-b339-852cb86a6123" containerName="perses" containerID="cri-o://3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada" gracePeriod=30
Oct 30 11:15:32.101803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.101780    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:15:32.194425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.194394    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"ab631be2-a161-45c1-b339-852cb86a6123\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") "
Oct 30 11:15:32.194609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.194490    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\" (UniqueName: \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\") pod \"ab631be2-a161-45c1-b339-852cb86a6123\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") "
Oct 30 11:15:32.194609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.194561    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\") pod \"ab631be2-a161-45c1-b339-852cb86a6123\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") "
Oct 30 11:15:32.194609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.194606    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\" (UniqueName: \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\") pod \"ab631be2-a161-45c1-b339-852cb86a6123\" (UID: \"ab631be2-a161-45c1-b339-852cb86a6123\") "
Oct 30 11:15:32.195237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.195190    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config" pod "ab631be2-a161-45c1-b339-852cb86a6123" (UID: "ab631be2-a161-45c1-b339-852cb86a6123"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:32.199759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.199237    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "ab631be2-a161-45c1-b339-852cb86a6123" (UID: "ab631be2-a161-45c1-b339-852cb86a6123"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:15:32.203508 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.203478    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl" pod "ab631be2-a161-45c1-b339-852cb86a6123" (UID: "ab631be2-a161-45c1-b339-852cb86a6123"). InnerVolumeSpecName "kube-api-access-79jhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:15:32.293247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.293215    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:15:32.293552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.293525    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" containerID="cri-o://876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea" gracePeriod=30
Oct 30 11:15:32.297317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.295816    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79jhl\" (UniqueName: \"kubernetes.io/projected/ab631be2-a161-45c1-b339-852cb86a6123-kube-api-access-79jhl\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:32.297317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.295869    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:15:32.297317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.295887    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab631be2-a161-45c1-b339-852cb86a6123-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:32.300785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.300757    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:15:32.301091 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.301030    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo" containerID="cri-o://b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b" gracePeriod=30
Oct 30 11:15:32.306134 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.306113    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:15:32.306370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.306327    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway" containerID="cri-o://47d019bf0f662df63937153d5d519f840bb4aaa160c1b1aed41a9b73b77a1c1e" gracePeriod=30
Oct 30 11:15:32.306540 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.306382    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway-opa" containerID="cri-o://94db7f7a8386a1770216409ab5c3e2856efc9efdaa526c845f7453bd2edb8bb5" gracePeriod=30
Oct 30 11:15:32.318301 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.318259    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:15:32.375289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.375257    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins" pod "ab631be2-a161-45c1-b339-852cb86a6123" (UID: "ab631be2-a161-45c1-b339-852cb86a6123"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:15:32.397146 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.397120    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ab631be2-a161-45c1-b339-852cb86a6123-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:32.397146 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.397147    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:15:32.486855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.486790    4488 generic.go:356] "Generic (PLEG): container finished" podID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerID="94db7f7a8386a1770216409ab5c3e2856efc9efdaa526c845f7453bd2edb8bb5" exitCode=0
Oct 30 11:15:32.487195 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.486862    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerDied","Data":"94db7f7a8386a1770216409ab5c3e2856efc9efdaa526c845f7453bd2edb8bb5"}
Oct 30 11:15:32.488197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.488169    4488 generic.go:356] "Generic (PLEG): container finished" podID="ab631be2-a161-45c1-b339-852cb86a6123" containerID="3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada" exitCode=0
Oct 30 11:15:32.488197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.488197    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ab631be2-a161-45c1-b339-852cb86a6123","Type":"ContainerDied","Data":"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"}
Oct 30 11:15:32.488417 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.488219    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ab631be2-a161-45c1-b339-852cb86a6123","Type":"ContainerDied","Data":"40dd485bb404f9b718ee6c8ef5ef8537a79221ffb231388c396f3963b4425102"}
Oct 30 11:15:32.488417 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.488225    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:15:32.488417 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.488234    4488 scope.go:122] "RemoveContainer" containerID="3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"
Oct 30 11:15:32.496530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.496508    4488 scope.go:122] "RemoveContainer" containerID="3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"
Oct 30 11:15:32.496894 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:15:32.496808    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada\": container with ID starting with 3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada not found: ID does not exist" containerID="3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"
Oct 30 11:15:32.496894 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.496842    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada"} err="failed to get container status \"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada\": rpc error: code = NotFound desc = could not find container \"3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada\": container with ID starting with 3ede65153b7951bfbd9e9e6517b036c25f99c817dc3baa07bc591b3eb7ecbada not found: ID does not exist"
Oct 30 11:15:32.546391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.546362    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:15:32.551060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:32.551038    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:15:33.496605 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.496577    4488 generic.go:356] "Generic (PLEG): container finished" podID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerID="47d019bf0f662df63937153d5d519f840bb4aaa160c1b1aed41a9b73b77a1c1e" exitCode=0
Oct 30 11:15:33.497031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.496644    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerDied","Data":"47d019bf0f662df63937153d5d519f840bb4aaa160c1b1aed41a9b73b77a1c1e"}
Oct 30 11:15:33.551852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.551832    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:15:33.604566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604544    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604658 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604604    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\" (UniqueName: \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604655    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604686    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604710    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604742    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.604803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.604778    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\") pod \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\" (UID: \"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad\") "
Oct 30 11:15:33.605159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.605118    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:33.605159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.605131    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:33.605328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.605167    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:33.606748 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.606724    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "serving-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:15:33.607142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.607122    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "tempo-data-science-tempostack-gateway-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:15:33.607228 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.607139    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "kube-api-access-8c95c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:15:33.610596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.610574    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant" pod "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" (UID: "fc39d86a-99e0-4bd3-884c-e5bc42ab8cad"). InnerVolumeSpecName "tenant". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:15:33.705880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705857    4488 reconciler_common.go:299] "Volume detached for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.705880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705879    4488 reconciler_common.go:299] "Volume detached for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tenant\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.706033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705887    4488 reconciler_common.go:299] "Volume detached for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-serving-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.706033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705896    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c95c\" (UniqueName: \"kubernetes.io/projected/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-kube-api-access-8c95c\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.706033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705905    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.706033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705914    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-tempo-data-science-tempostack-gateway-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.706033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.705922    4488 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:33.804149 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.804125    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab631be2-a161-45c1-b339-852cb86a6123" path="/var/lib/kubelet/pods/ab631be2-a161-45c1-b339-852cb86a6123/volumes"
Oct 30 11:15:33.844548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.844521    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:15:33.846840 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.846821    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:15:33.881527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.881506    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:15:33.881681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:33.881661    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" containerName="seaweedfs" containerID="cri-o://086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4" gracePeriod=30
Oct 30 11:15:34.169603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.169566    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:34.192034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.192004    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:34.503282 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.503207    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k" event={"ID":"fc39d86a-99e0-4bd3-884c-e5bc42ab8cad","Type":"ContainerDied","Data":"28e8d89b51b7d0f5e8beeee4f263929610c4d1fd10eb7e688715468d77db71ff"}
Oct 30 11:15:34.503282 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.503250    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"
Oct 30 11:15:34.503716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.503292    4488 scope.go:122] "RemoveContainer" containerID="94db7f7a8386a1770216409ab5c3e2856efc9efdaa526c845f7453bd2edb8bb5"
Oct 30 11:15:34.511427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.511412    4488 scope.go:122] "RemoveContainer" containerID="47d019bf0f662df63937153d5d519f840bb4aaa160c1b1aed41a9b73b77a1c1e"
Oct 30 11:15:34.560463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.560441    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:15:34.574459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.574436    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5fbddb975c-nj52k"]
Oct 30 11:15:34.835033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.835010    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:15:34.913969 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.913936    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\") pod \"a6a570b2-d292-4b79-ba01-6f63b932e175\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") "
Oct 30 11:15:34.914082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.913986    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\") pod \"a6a570b2-d292-4b79-ba01-6f63b932e175\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") "
Oct 30 11:15:34.914082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914026    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\") pod \"a6a570b2-d292-4b79-ba01-6f63b932e175\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") "
Oct 30 11:15:34.914082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914057    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\") pod \"a6a570b2-d292-4b79-ba01-6f63b932e175\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") "
Oct 30 11:15:34.914207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914100    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\" (UniqueName: \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\") pod \"a6a570b2-d292-4b79-ba01-6f63b932e175\" (UID: \"a6a570b2-d292-4b79-ba01-6f63b932e175\") "
Oct 30 11:15:34.914498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914465    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle" pod "a6a570b2-d292-4b79-ba01-6f63b932e175" (UID: "a6a570b2-d292-4b79-ba01-6f63b932e175"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:34.914498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914490    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf" pod "a6a570b2-d292-4b79-ba01-6f63b932e175" (UID: "a6a570b2-d292-4b79-ba01-6f63b932e175"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:15:34.914645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.914471    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage" pod "a6a570b2-d292-4b79-ba01-6f63b932e175" (UID: "a6a570b2-d292-4b79-ba01-6f63b932e175"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:15:34.916099 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.916075    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9" pod "a6a570b2-d292-4b79-ba01-6f63b932e175" (UID: "a6a570b2-d292-4b79-ba01-6f63b932e175"). InnerVolumeSpecName "kube-api-access-z5df9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:15:34.916172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:34.916078    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls" pod "a6a570b2-d292-4b79-ba01-6f63b932e175" (UID: "a6a570b2-d292-4b79-ba01-6f63b932e175"). InnerVolumeSpecName "tempo-data-science-tempostack-compactor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:15:35.014679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.014612    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:35.014679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.014638    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:35.014679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.014652    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-compactor-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:35.014679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.014669    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a570b2-d292-4b79-ba01-6f63b932e175-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:35.014877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.014683    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5df9\" (UniqueName: \"kubernetes.io/projected/a6a570b2-d292-4b79-ba01-6f63b932e175-kube-api-access-z5df9\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:35.508901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.508873    4488 generic.go:356] "Generic (PLEG): container finished" podID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerID="876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea" exitCode=0
Oct 30 11:15:35.509289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.508926    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"
Oct 30 11:15:35.509289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.508963    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" event={"ID":"a6a570b2-d292-4b79-ba01-6f63b932e175","Type":"ContainerDied","Data":"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"}
Oct 30 11:15:35.509289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.509014    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl" event={"ID":"a6a570b2-d292-4b79-ba01-6f63b932e175","Type":"ContainerDied","Data":"aba4069bc4335769cc7a792053e13a2cfc510b1ed3de49e2d7b79df97fcfaaf1"}
Oct 30 11:15:35.509289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.509046    4488 scope.go:122] "RemoveContainer" containerID="876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"
Oct 30 11:15:35.518070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.518055    4488 scope.go:122] "RemoveContainer" containerID="876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"
Oct 30 11:15:35.518306 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:15:35.518285    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea\": container with ID starting with 876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea not found: ID does not exist" containerID="876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"
Oct 30 11:15:35.518373 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.518318    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea"} err="failed to get container status \"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea\": rpc error: code = NotFound desc = could not find container \"876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea\": container with ID starting with 876fd0d91f6b0ee47d85aaf909e3593c46160a2919abd88b7ab9cbce340ad6ea not found: ID does not exist"
Oct 30 11:15:35.566079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.566054    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:15:35.580182 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.580156    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-746d6f54c5-fn4rl"]
Oct 30 11:15:35.802423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.802362    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d73e0d5-b4d8-4cfb-911a-9087b00ede4c" path="/var/lib/kubelet/pods/1d73e0d5-b4d8-4cfb-911a-9087b00ede4c/volumes"
Oct 30 11:15:35.802761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.802749    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" path="/var/lib/kubelet/pods/a6a570b2-d292-4b79-ba01-6f63b932e175/volumes"
Oct 30 11:15:35.803079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:35.803068    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" path="/var/lib/kubelet/pods/fc39d86a-99e0-4bd3-884c-e5bc42ab8cad/volumes"
Oct 30 11:15:44.170333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:44.170291    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:54.169765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:54.169724    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:15:54.170233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:54.169827    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:15:59.127958 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.127933    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:15:59.180908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.180878    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\" (UniqueName: \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\") pod \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") "
Oct 30 11:15:59.181074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.180928    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\" (UniqueName: \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\") pod \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\" (UID: \"67edf1e2-27d8-4184-a26f-c1bf742b7b6f\") "
Oct 30 11:15:59.182605 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.182572    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data" pod "67edf1e2-27d8-4184-a26f-c1bf742b7b6f" (UID: "67edf1e2-27d8-4184-a26f-c1bf742b7b6f"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:15:59.183279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.183255    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj" pod "67edf1e2-27d8-4184-a26f-c1bf742b7b6f" (UID: "67edf1e2-27d8-4184-a26f-c1bf742b7b6f"). InnerVolumeSpecName "kube-api-access-xcmcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:15:59.282013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.281984    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcmcj\" (UniqueName: \"kubernetes.io/projected/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-kube-api-access-xcmcj\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:59.282013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.282010    4488 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67edf1e2-27d8-4184-a26f-c1bf742b7b6f-data\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:15:59.617155 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.617076    4488 generic.go:356] "Generic (PLEG): container finished" podID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" containerID="086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4" exitCode=0
Oct 30 11:15:59.617155 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.617117    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:15:59.617334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.617163    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"67edf1e2-27d8-4184-a26f-c1bf742b7b6f","Type":"ContainerDied","Data":"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"}
Oct 30 11:15:59.617334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.617202    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"67edf1e2-27d8-4184-a26f-c1bf742b7b6f","Type":"ContainerDied","Data":"a9cfe8fe5c55fef7b3e2554d6428ae57e87eb4522f7c3985c9e100ff06cb1ba3"}
Oct 30 11:15:59.617334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.617219    4488 scope.go:122] "RemoveContainer" containerID="086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"
Oct 30 11:15:59.626317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.626298    4488 scope.go:122] "RemoveContainer" containerID="086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"
Oct 30 11:15:59.626593 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:15:59.626574    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4\": container with ID starting with 086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4 not found: ID does not exist" containerID="086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"
Oct 30 11:15:59.626643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.626602    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4"} err="failed to get container status \"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4\": rpc error: code = NotFound desc = could not find container \"086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4\": container with ID starting with 086dd8a93c6d72ccbf3c8fddde79ffbe6cc7322ddc3c59b230a827fcac8d18e4 not found: ID does not exist"
Oct 30 11:15:59.674186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.674162    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:15:59.688108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.688086    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:15:59.802206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:15:59.802181    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" path="/var/lib/kubelet/pods/67edf1e2-27d8-4184-a26f-c1bf742b7b6f/volumes"
Oct 30 11:16:01.478779 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:16:01.478743    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:16:02.463806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.463776    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:16:02.464132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464114    4488 cpu_manager.go:414] "containerMap: removing container" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway-opa"
Oct 30 11:16:02.464214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464135    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway-opa"
Oct 30 11:16:02.464214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464175    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo"
Oct 30 11:16:02.464214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464185    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo"
Oct 30 11:16:02.464214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464200    4488 cpu_manager.go:414] "containerMap: removing container" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway"
Oct 30 11:16:02.464214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464208    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464218    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ab631be2-a161-45c1-b339-852cb86a6123" containerName="perses"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464226    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab631be2-a161-45c1-b339-852cb86a6123" containerName="perses"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464248    4488 cpu_manager.go:414] "containerMap: removing container" podUID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" containerName="seaweedfs"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464256    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" containerName="seaweedfs"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464320    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a570b2-d292-4b79-ba01-6f63b932e175" containerName="tempo"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464333    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464365    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab631be2-a161-45c1-b339-852cb86a6123" containerName="perses"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464379    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="67edf1e2-27d8-4184-a26f-c1bf742b7b6f" containerName="seaweedfs"
Oct 30 11:16:02.464490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.464389    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc39d86a-99e0-4bd3-884c-e5bc42ab8cad" containerName="tempo-gateway-opa"
Oct 30 11:16:02.469136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.469114    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.486504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.486476    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:16:02.495746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.495726    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:16:02.499221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.499206    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:16:02.506920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.506887    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.507024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.506956    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x58w5\" (UniqueName: \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.607687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607630    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\") pod \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") "
Oct 30 11:16:02.607687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607679    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\" (UniqueName: \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\") pod \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") "
Oct 30 11:16:02.607827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607712    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\") pod \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") "
Oct 30 11:16:02.607827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607734    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\") pod \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") "
Oct 30 11:16:02.607912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607830    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\") pod \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\" (UID: \"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d\") "
Oct 30 11:16:02.607960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607945    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.608018 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.607996    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage" pod "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" (UID: "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:16:02.608076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.608003    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58w5\" (UniqueName: \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.608135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.608112    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:02.608193 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.608170    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle" pod "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" (UID: "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:16:02.608397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.608375    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf" pod "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" (UID: "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:16:02.608477 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.608422    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.609838 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.609818    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb" pod "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" (UID: "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d"). InnerVolumeSpecName "kube-api-access-f5mrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:16:02.609923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.609902    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls" pod "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" (UID: "e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d"). InnerVolumeSpecName "tempo-data-science-tempostack-query-frontend-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:16:02.633302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.633273    4488 generic.go:356] "Generic (PLEG): container finished" podID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerID="b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b" exitCode=137
Oct 30 11:16:02.633414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.633314    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"
Oct 30 11:16:02.633414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.633333    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" event={"ID":"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d","Type":"ContainerDied","Data":"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"}
Oct 30 11:16:02.633414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.633407    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj" event={"ID":"e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d","Type":"ContainerDied","Data":"395259ef6ac35e3c5a8c94a6b6c4ac671282bd2821764546dce8c166a919cfe7"}
Oct 30 11:16:02.633559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.633442    4488 scope.go:122] "RemoveContainer" containerID="b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"
Oct 30 11:16:02.634874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.634841    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58w5\" (UniqueName: \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\") pod \"fake-gcs-server\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:02.644845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.644824    4488 scope.go:122] "RemoveContainer" containerID="b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"
Oct 30 11:16:02.645108 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:16:02.645092    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b\": container with ID starting with b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b not found: ID does not exist" containerID="b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"
Oct 30 11:16:02.645146 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.645116    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b"} err="failed to get container status \"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b\": rpc error: code = NotFound desc = could not find container \"b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b\": container with ID starting with b75312b3c7d6b41846827fb8e9648ae8b2164dbcdd8452151ae7e4145324784b not found: ID does not exist"
Oct 30 11:16:02.689641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.689619    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:16:02.693200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.693182    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-754dc6949b-tx5jj"]
Oct 30 11:16:02.708577 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.708562    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:02.708638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.708581    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5mrb\" (UniqueName: \"kubernetes.io/projected/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-kube-api-access-f5mrb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:02.708638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.708590    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:02.708638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.708601    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d-tempo-data-science-tempostack-query-frontend-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:02.781871 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:02.781852    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:03.078800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:03.078777    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:16:03.080973 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:03.080950    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c63551f_6ac5_4214_bd8e_a15a5cc3a38d.slice/crio-58bce62869b832a4fa3ce36deafd3cfbfb22591d1749c72975a2bcef6d110e13 WatchSource:0}: Error finding container 58bce62869b832a4fa3ce36deafd3cfbfb22591d1749c72975a2bcef6d110e13: Status 404 returned error can't find the container with id 58bce62869b832a4fa3ce36deafd3cfbfb22591d1749c72975a2bcef6d110e13
Oct 30 11:16:03.641848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:03.641803    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d","Type":"ContainerStarted","Data":"58bce62869b832a4fa3ce36deafd3cfbfb22591d1749c72975a2bcef6d110e13"}
Oct 30 11:16:03.802612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:03.802583    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" path="/var/lib/kubelet/pods/e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d/volumes"
Oct 30 11:16:04.302672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.302643    4488 scope.go:122] "RemoveContainer" containerID="ed4ce34b17156c74093e6957314046da609e8b1b990dc537a38c3feba5bc2825"
Oct 30 11:16:04.310469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.310449    4488 scope.go:122] "RemoveContainer" containerID="58b8f4138c85dd35eadafa607e29ff74804182591b2dd5100f7406a39fecda1e"
Oct 30 11:16:04.317436 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.317416    4488 scope.go:122] "RemoveContainer" containerID="e721da619bcfafdd36f3f894efbd78ed6ec3eafefed34b1925adf1adc14189a2"
Oct 30 11:16:04.324618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.324600    4488 scope.go:122] "RemoveContainer" containerID="c74d3bf3461f0f582c5cd39bbeaab88b5debb16805bbc0a5cbcbf99a2cce225c"
Oct 30 11:16:04.332427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.332410    4488 scope.go:122] "RemoveContainer" containerID="07a2c9a229f5fabea2f55eccef61f6e206e15025719f30c45f4d7b86f7e53189"
Oct 30 11:16:04.340185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.340171    4488 scope.go:122] "RemoveContainer" containerID="f41f4c78a67dc0b8aed6081a3387240b8f9e3335787894611592e4d1d14274c4"
Oct 30 11:16:04.346766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.346744    4488 scope.go:122] "RemoveContainer" containerID="e48444e83f5c690006e5394d87f6e8641f0f06c49e38a9f93633e69ac586c956"
Oct 30 11:16:04.353512 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.353496    4488 scope.go:122] "RemoveContainer" containerID="f9edfe9607353a0ccdd3c6b57a48fb407958f60fc5e5802e1ce810ccd09b3e63"
Oct 30 11:16:04.360171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.360139    4488 scope.go:122] "RemoveContainer" containerID="1f13d387e8997d09cd861124f86aa36fd95c46d87409ffe9d27eeca7eae97474"
Oct 30 11:16:04.366732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.366712    4488 scope.go:122] "RemoveContainer" containerID="882af69e47adea9118b07adbb2f39b386a150f8d2504b81a2c1329f3895707e6"
Oct 30 11:16:04.648281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.648204    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d","Type":"ContainerStarted","Data":"d2aa425b20138736788045e29247ce679f7523955315f7bced144032f1282552"}
Oct 30 11:16:04.648660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.648292    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:04.696114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:04.696072    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/fake-gcs-server" podStartSLOduration=1.6752181510000002 podStartE2EDuration="2.696061044s" totalImagesPullingTime="1.020842893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:04.694692823 +0000 UTC m=+1861.040284678" watchObservedRunningTime="2026-10-30 11:16:04.696061044 +0000 UTC m=+1861.041652898"
Oct 30 11:16:10.654531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:10.654504    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:16:12.649085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.649049    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 11:16:12.649500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.649315    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo"
Oct 30 11:16:12.649500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.649324    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo"
Oct 30 11:16:12.649500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.649408    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7cfd71a-d8c5-4e4b-9ea2-5e8c4400f98d" containerName="tempo"
Oct 30 11:16:12.654230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.654213    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:12.668473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.668452    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 11:16:12.778023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.777993    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qvc4\" (UniqueName: \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\") pod \"fake-gcs-bucket-creator\" (UID: \"8ecd32ff-0425-42d5-bc34-48d02d0788d7\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:12.879008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.878980    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qvc4\" (UniqueName: \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\") pod \"fake-gcs-bucket-creator\" (UID: \"8ecd32ff-0425-42d5-bc34-48d02d0788d7\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:12.904491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.904432    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qvc4\" (UniqueName: \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\") pod \"fake-gcs-bucket-creator\" (UID: \"8ecd32ff-0425-42d5-bc34-48d02d0788d7\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:12.966111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:12.966090    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:13.264733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:13.264704    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 11:16:13.267764 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:13.267737    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ecd32ff_0425_42d5_bc34_48d02d0788d7.slice/crio-bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727 WatchSource:0}: Error finding container bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727: Status 404 returned error can't find the container with id bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727
Oct 30 11:16:13.684928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:13.684890    4488 generic.go:356] "Generic (PLEG): container finished" podID="8ecd32ff-0425-42d5-bc34-48d02d0788d7" containerID="cd933cd1c677c5cf7eda59cc4b2fc9dfe0722d00c622ab41aad39aea5b5ba40e" exitCode=0
Oct 30 11:16:13.685377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:13.684940    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"8ecd32ff-0425-42d5-bc34-48d02d0788d7","Type":"ContainerDied","Data":"cd933cd1c677c5cf7eda59cc4b2fc9dfe0722d00c622ab41aad39aea5b5ba40e"}
Oct 30 11:16:13.685377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:13.684983    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"8ecd32ff-0425-42d5-bc34-48d02d0788d7","Type":"ContainerStarted","Data":"bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727"}
Oct 30 11:16:14.809500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:14.809476    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:14.895245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:14.895219    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\" (UniqueName: \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\") pod \"8ecd32ff-0425-42d5-bc34-48d02d0788d7\" (UID: \"8ecd32ff-0425-42d5-bc34-48d02d0788d7\") "
Oct 30 11:16:14.897098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:14.897079    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4" pod "8ecd32ff-0425-42d5-bc34-48d02d0788d7" (UID: "8ecd32ff-0425-42d5-bc34-48d02d0788d7"). InnerVolumeSpecName "kube-api-access-7qvc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:16:14.995765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:14.995711    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qvc4\" (UniqueName: \"kubernetes.io/projected/8ecd32ff-0425-42d5-bc34-48d02d0788d7-kube-api-access-7qvc4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:16:15.695271 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:15.695240    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 11:16:15.695528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:15.695243    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"8ecd32ff-0425-42d5-bc34-48d02d0788d7","Type":"ContainerDied","Data":"bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727"}
Oct 30 11:16:15.695528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:15.695371    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf3a0f3c9fe7d90e98ebea446c48cf136dfe28b1c9dca7ddc5c7ed7c44397727"
Oct 30 11:16:18.657584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.657559    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:16:18.657979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.657882    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8ecd32ff-0425-42d5-bc34-48d02d0788d7" containerName="create-bucket"
Oct 30 11:16:18.657979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.657895    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ecd32ff-0425-42d5-bc34-48d02d0788d7" containerName="create-bucket"
Oct 30 11:16:18.657979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.657949    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ecd32ff-0425-42d5-bc34-48d02d0788d7" containerName="create-bucket"
Oct 30 11:16:18.660968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.660946    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.680108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.680082    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:16:18.693036 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.693013    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:16:18.719845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.719823    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.719953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.719848    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4mq\" (UniqueName: \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.719953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.719894    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.820269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.820246    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.820391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.820271    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4mq\" (UniqueName: \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.820391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.820356    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.820672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.820656    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.820938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.820920    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:18.847968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:18.847940    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4mq\" (UniqueName: \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.035609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.035566    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.067720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.067692    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.136148 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.136124    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.136272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.136251    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.152663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.152640    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.253801 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.253778    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.284051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.284031    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.372171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.372124    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:21.667651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.667576    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:16:21.671114 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:21.671082    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf983f4f6_90b2_47b3_b856_5646c00faf9b.slice/crio-1d23d8675c4f9de0f5c59eb736d74f04e05df5ff13994621eb511d473a7fdab2 WatchSource:0}: Error finding container 1d23d8675c4f9de0f5c59eb736d74f04e05df5ff13994621eb511d473a7fdab2: Status 404 returned error can't find the container with id 1d23d8675c4f9de0f5c59eb736d74f04e05df5ff13994621eb511d473a7fdab2
Oct 30 11:16:21.720618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:21.720594    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f983f4f6-90b2-47b3-b856-5646c00faf9b","Type":"ContainerStarted","Data":"1d23d8675c4f9de0f5c59eb736d74f04e05df5ff13994621eb511d473a7fdab2"}
Oct 30 11:16:22.726622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.726584    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f983f4f6-90b2-47b3-b856-5646c00faf9b","Type":"ContainerStarted","Data":"5e909047a6fca3f703fbb603932f013d6e64ad2fb1018a9f0f80a5dac9c810a0"}
Oct 30 11:16:22.727074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.726735    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:22.787380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.787311    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.787298368 podStartE2EDuration="4.787298368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:22.777987556 +0000 UTC m=+1879.123579409" watchObservedRunningTime="2026-10-30 11:16:22.787298368 +0000 UTC m=+1879.132890231"
Oct 30 11:16:22.876990 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.876950    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:16:22.885887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.885865    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.904203 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.904173    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:16:22.904831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.904805    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-ca-bundle\""
Oct 30 11:16:22.904939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.904914    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack\""
Oct 30 11:16:22.916456 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.916436    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-query-frontend-mtls\""
Oct 30 11:16:22.916570 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.916459    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"gcs-secret\""
Oct 30 11:16:22.916651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.916635    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-dockercfg-264xv\""
Oct 30 11:16:22.950983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.950936    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.951167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.950992    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.951253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.951146    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.951319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.951250    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.951319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.951307    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.951454 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.951398    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tncbw\" (UniqueName: \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:22.965067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.965033    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:16:22.970737 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.970717    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:22.994904 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:22.994879    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:16:23.013022 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.012990    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-compactor-mtls\""
Oct 30 11:16:23.052138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052103    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.052278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052150    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052230    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052280    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052360    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052390    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.052587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052425    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.052587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052525    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052584    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhx7h\" (UniqueName: \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.052710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052603    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.052710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052621    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.052872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052737    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.053165 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.052824    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tncbw\" (UniqueName: \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.053285 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.053268    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.053370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.053281    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.055072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.055044    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.055184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.055101    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.079785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.079739    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tncbw\" (UniqueName: \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\") pod \"tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.153993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.153960    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhx7h\" (UniqueName: \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.153993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.153995    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154018    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154060    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154116    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154148    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154517    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.154868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.154849    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.155434 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.155408    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.156680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.156653    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.156763 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.156677    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.178985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.178965    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhx7h\" (UniqueName: \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\") pod \"tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.206008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.205988    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:23.282673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.282648    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:23.513810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.513776    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:16:23.520399 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.520327    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.528279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.528257    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:16:23.532320 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:23.532293    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef WatchSource:0}: Error finding container 708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef: Status 404 returned error can't find the container with id 708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef
Oct 30 11:16:23.539158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.538592    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-distributor-mtls\""
Oct 30 11:16:23.541149 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.541079    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:16:23.597086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.597059    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:16:23.616975 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.616931    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:16:23.623156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.623132    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.642334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.642307    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:16:23.659110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.659082    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.659253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.659234    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.659334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.659313    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2tj\" (UniqueName: \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.659425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.659407    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.659485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.659463    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.692859 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:23.692821    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f6348f_94a5_4b98_bfb0_9a306c1a3f33.slice/crio-1358e8d9a4dbfc2645e0f3913abd47085a229a9fa93e164b59d8639a49274441 WatchSource:0}: Error finding container 1358e8d9a4dbfc2645e0f3913abd47085a229a9fa93e164b59d8639a49274441: Status 404 returned error can't find the container with id 1358e8d9a4dbfc2645e0f3913abd47085a229a9fa93e164b59d8639a49274441
Oct 30 11:16:23.715207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.715182    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:16:23.720355 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.720326    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.733599 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.733574    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" event={"ID":"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33","Type":"ContainerStarted","Data":"1358e8d9a4dbfc2645e0f3913abd47085a229a9fa93e164b59d8639a49274441"}
Oct 30 11:16:23.734825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.734805    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" event={"ID":"5f9d27ee-2713-4e83-9f98-bb0ab20300d3","Type":"ContainerStarted","Data":"708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef"}
Oct 30 11:16:23.739288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.739266    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-mtls\""
Oct 30 11:16:23.739409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.739392    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 11:16:23.739629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.739449    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-tls\""
Oct 30 11:16:23.739629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.739534    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-dockercfg-k4tkl\""
Oct 30 11:16:23.739629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.739607    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-querier-mtls\""
Oct 30 11:16:23.745758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.745735    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:16:23.760259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760239    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.760371 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760282    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.760371 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760302    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.760521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760503    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.760589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760539    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.760589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760582    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2tj\" (UniqueName: \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.760689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760607    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.760689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760641    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.760689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760669    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrkt\" (UniqueName: \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.760844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760827    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.760896 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.760871    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.761221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.761201    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.761319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.761295    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.761514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.761498    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.764439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.764416    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.785863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.785818    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2tj\" (UniqueName: \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\") pod \"tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.818848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.818828    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 11:16:23.819051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.819034    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-cabundle\""
Oct 30 11:16:23.836046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.836022    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:23.861812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861777    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.861937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861825    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.861937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861860    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrkt\" (UniqueName: \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.861937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861893    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7kj9\" (UniqueName: \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.861937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861920    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.862103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861943    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.862103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.861977    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.862103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862074    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.862200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862113    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.862200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862140    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.862200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862149    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.862305 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862215    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.862869 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862843    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.862948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862857    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.863023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.862984    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.863075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.863045    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.864782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.864764    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.864997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.864978    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.896186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.896160    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrkt\" (UniqueName: \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\") pod \"tempo-data-science-tempostack-querier-759dff96bd-vwqjq\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.936382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.936356    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:23.964008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.963982    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964034    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7kj9\" (UniqueName: \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964053    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964074    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964151    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964189    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964227    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.964944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964917    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.965063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964982    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.965063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.964993    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.966682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.966653    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.966892 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.966874    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.966941 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.966880    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:23.993310 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:23.993278    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7kj9\" (UniqueName: \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\") pod \"tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:24.038784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.038721    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:24.144148 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.144125    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:16:24.146145 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:24.146118    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0294900_5d8a_4daf_b27a_8fa12b1ea088.slice/crio-8d9200539eee6c2fbc752de164219425ee1c32d9063387b52f2dd85b8ff95e6f WatchSource:0}: Error finding container 8d9200539eee6c2fbc752de164219425ee1c32d9063387b52f2dd85b8ff95e6f: Status 404 returned error can't find the container with id 8d9200539eee6c2fbc752de164219425ee1c32d9063387b52f2dd85b8ff95e6f
Oct 30 11:16:24.238054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.238032    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:16:24.268207 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:24.268185    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c060877_40ef_4b2e_8908_44f9f8e0eaaf.slice/crio-fd82ea0166047186c8bbc0d3ddb38e157d32fc1bfafd5256294622398c6e791f WatchSource:0}: Error finding container fd82ea0166047186c8bbc0d3ddb38e157d32fc1bfafd5256294622398c6e791f: Status 404 returned error can't find the container with id fd82ea0166047186c8bbc0d3ddb38e157d32fc1bfafd5256294622398c6e791f
Oct 30 11:16:24.341451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.341420    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:16:24.345197 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:24.345174    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee5d0f_7210_4e3d_b4b1_aeec61aa4e69.slice/crio-a021443216530c4dc1b6f7ec8de689ab449cca037a18f67847d380acb8025c10 WatchSource:0}: Error finding container a021443216530c4dc1b6f7ec8de689ab449cca037a18f67847d380acb8025c10: Status 404 returned error can't find the container with id a021443216530c4dc1b6f7ec8de689ab449cca037a18f67847d380acb8025c10
Oct 30 11:16:24.740699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.740670    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerStarted","Data":"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"}
Oct 30 11:16:24.741070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.740732    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerStarted","Data":"a021443216530c4dc1b6f7ec8de689ab449cca037a18f67847d380acb8025c10"}
Oct 30 11:16:24.742229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.742207    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" event={"ID":"5f9d27ee-2713-4e83-9f98-bb0ab20300d3","Type":"ContainerStarted","Data":"771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72"}
Oct 30 11:16:24.742350 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.742325    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:24.743837 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.743816    4488 generic.go:356] "Generic (PLEG): container finished" podID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerID="3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915" exitCode=1
Oct 30 11:16:24.743938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.743893    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" event={"ID":"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33","Type":"ContainerDied","Data":"3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"}
Oct 30 11:16:24.744048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.744033    4488 scope.go:122] "RemoveContainer" containerID="3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"
Oct 30 11:16:24.745567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.745449    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" event={"ID":"c0294900-5d8a-4daf-b27a-8fa12b1ea088","Type":"ContainerStarted","Data":"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"}
Oct 30 11:16:24.745567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.745503    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:24.745567 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.745530    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" event={"ID":"c0294900-5d8a-4daf-b27a-8fa12b1ea088","Type":"ContainerStarted","Data":"8d9200539eee6c2fbc752de164219425ee1c32d9063387b52f2dd85b8ff95e6f"}
Oct 30 11:16:24.747025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.747005    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" event={"ID":"7c060877-40ef-4b2e-8908-44f9f8e0eaaf","Type":"ContainerStarted","Data":"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"}
Oct 30 11:16:24.747073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.747048    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" event={"ID":"7c060877-40ef-4b2e-8908-44f9f8e0eaaf","Type":"ContainerStarted","Data":"fd82ea0166047186c8bbc0d3ddb38e157d32fc1bfafd5256294622398c6e791f"}
Oct 30 11:16:24.747108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.747085    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:24.789021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.788978    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" podStartSLOduration=2.788968198 podStartE2EDuration="2.788968198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:24.788361511 +0000 UTC m=+1881.133953388" watchObservedRunningTime="2026-10-30 11:16:24.788968198 +0000 UTC m=+1881.134560046"
Oct 30 11:16:24.837419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.837376    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" podStartSLOduration=1.8373629820000001 podStartE2EDuration="1.837362982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:24.836718153 +0000 UTC m=+1881.182310006" watchObservedRunningTime="2026-10-30 11:16:24.837362982 +0000 UTC m=+1881.182954833"
Oct 30 11:16:24.883978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:24.883936    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" podStartSLOduration=1.883923946 podStartE2EDuration="1.883923946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:24.882855214 +0000 UTC m=+1881.228447068" watchObservedRunningTime="2026-10-30 11:16:24.883923946 +0000 UTC m=+1881.229515800"
Oct 30 11:16:25.659709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.659680    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:16:25.664724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.664706    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.682026 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.682005    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-ingester-mtls\""
Oct 30 11:16:25.684657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.684633    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:16:25.753681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.753648    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerStarted","Data":"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"}
Oct 30 11:16:25.754092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.753821    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:25.754092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.753892    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:25.755147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.755119    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.116:8083/ready\": dial tcp 10.133.0.116:8083: connect: connection refused"
Oct 30 11:16:25.755926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.755898    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" event={"ID":"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33","Type":"ContainerStarted","Data":"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"}
Oct 30 11:16:25.756035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.755953    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:16:25.781387 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.781362    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.781470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.781422    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ingester-mtls\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.781734 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.781708    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.781855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.781793    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.782029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.782010    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.803752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.803713    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" podStartSLOduration=2.803702543 podStartE2EDuration="2.803702543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:25.802284412 +0000 UTC m=+1882.147876267" watchObservedRunningTime="2026-10-30 11:16:25.803702543 +0000 UTC m=+1882.149294396"
Oct 30 11:16:25.849115 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.849078    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podStartSLOduration=3.849068128 podStartE2EDuration="3.849068128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:25.848122847 +0000 UTC m=+1882.193714698" watchObservedRunningTime="2026-10-30 11:16:25.849068128 +0000 UTC m=+1882.194659976"
Oct 30 11:16:25.883075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.883049    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.883191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.883097    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.883881 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.883454    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.883881 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.883537    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.883881 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.883576    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ingester-mtls\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.884110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.884089    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.884205 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.884188    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.886450 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.886429    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ingester-mtls\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.886565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.886545    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:25.908233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:25.908210    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:26.491241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:26.491208    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:26.761993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:26.761916    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:16:31.477946 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:16:31.477910    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:16:33.643365 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.643316    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.676021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.675993    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.737679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.737658    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:16:33.744444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.744420    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.744557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.744538    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.760539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.760519    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") DevicePath \"csi-4d7328022bfc04cafd97424f1ef455357ed8326ede74ab5404fd6354555574d5\"" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.863628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.863593    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/d70e14611a39016552cec14e417282f8e35c0e121c562713dc7ac62abf656297/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:33.891572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:33.891542    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"tempo-data-science-tempostack-ingester-0\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:34.077120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.077060    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:34.399382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.399218    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:16:34.402873 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:16:34.402839    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53113049_0495_4c61_a839_5d4723efa780.slice/crio-bdaca958c7f478e15e3d8c92bb37f76dc4f759eb4a13c3adc9ee7a51e5fe9bc0 WatchSource:0}: Error finding container bdaca958c7f478e15e3d8c92bb37f76dc4f759eb4a13c3adc9ee7a51e5fe9bc0: Status 404 returned error can't find the container with id bdaca958c7f478e15e3d8c92bb37f76dc4f759eb4a13c3adc9ee7a51e5fe9bc0
Oct 30 11:16:34.798181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.798148    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" event={"ID":"53113049-0495-4c61-a839-5d4723efa780","Type":"ContainerStarted","Data":"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"}
Oct 30 11:16:34.798603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.798203    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" event={"ID":"53113049-0495-4c61-a839-5d4723efa780","Type":"ContainerStarted","Data":"bdaca958c7f478e15e3d8c92bb37f76dc4f759eb4a13c3adc9ee7a51e5fe9bc0"}
Oct 30 11:16:34.798603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.798297    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:16:34.845357 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:34.845300    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" podStartSLOduration=9.845288555 podStartE2EDuration="9.845288555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:16:34.843957487 +0000 UTC m=+1891.189549341" watchObservedRunningTime="2026-10-30 11:16:34.845288555 +0000 UTC m=+1891.190880409"
Oct 30 11:16:45.761766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:45.761732    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:16:45.762190 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:45.762062    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:16:45.762437 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:45.762418    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:16:46.766870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:46.766839    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:16:47.748770 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:47.748740    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:16:47.748980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:47.748958    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo" containerID="cri-o://771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72" gracePeriod=30
Oct 30 11:16:55.808953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:55.808919    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:16:56.191131 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:56.191099    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:16:56.764849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:16:56.764814    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:01.478362 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:01.478305    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:17:04.430198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.430161    4488 scope.go:122] "RemoveContainer" containerID="bde1939ba2b9e5b82679fcc2ae424d49729a13668797aa8c178a61a07db0092c"
Oct 30 11:17:04.438829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.438807    4488 scope.go:122] "RemoveContainer" containerID="fa7a60fbccf2afcb2638afbbf9ed50eb58f32a148f6930ef544b18b8aac26599"
Oct 30 11:17:04.446254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.446236    4488 scope.go:122] "RemoveContainer" containerID="a627daca84da79904aca30982a1e5ddb1fdc5ab1f784b075ceacfbfe3b662d58"
Oct 30 11:17:04.453067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.453050    4488 scope.go:122] "RemoveContainer" containerID="1ed839dc86701dc8969cba383dcb436450357229bcb7c15cd606e389533d047b"
Oct 30 11:17:04.459609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.459595    4488 scope.go:122] "RemoveContainer" containerID="09331216142e3625130c2905a2b68342f0a7eece87dffbb8e00b04b3d176ef98"
Oct 30 11:17:04.469607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.469579    4488 scope.go:122] "RemoveContainer" containerID="70603e1ca33903977de97e53a3b7dd6b60ede1a255e8efe7b2bafe966be5c58c"
Oct 30 11:17:04.476132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:04.476111    4488 scope.go:122] "RemoveContainer" containerID="ad42d85e164d8a476e7631cff0a04a6417c5adeefe201f8195ab8a4e95a42f2e"
Oct 30 11:17:05.807738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:05.807697    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:05.898428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:05.898397    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:06.764152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:06.764117    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:15.795251 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:15.795211    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:15.795646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:15.795313    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:17:15.807347 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:15.807325    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:17:16.764516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:16.764431    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:17:17.879081 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:17.879045    4488 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-conmon-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 11:17:17.879485 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:17.879051    4488 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-conmon-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 11:17:17.879485 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:17.879232    4488 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-conmon-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 11:17:17.879485 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:17.879371    4488 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9d27ee_2713_4e83_9f98_bb0ab20300d3.slice/crio-708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef\": RecentStats: unable to find data in memory cache]"
Oct 30 11:17:17.986745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:17.986716    4488 generic.go:356] "Generic (PLEG): container finished" podID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerID="771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72" exitCode=137
Oct 30 11:17:17.986870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:17.986782    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" event={"ID":"5f9d27ee-2713-4e83-9f98-bb0ab20300d3","Type":"ContainerDied","Data":"771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72"}
Oct 30 11:17:18.005918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.005876    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:17:18.091984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.091961    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.091998    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\" (UniqueName: \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092027    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092104    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092124    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092205    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\") pod \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\" (UID: \"5f9d27ee-2713-4e83-9f98-bb0ab20300d3\") "
Oct 30 11:17:18.092478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092442    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:17:18.092612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092583    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:17:18.092727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.092640    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:17:18.094188 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.094163    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "tempo-data-science-tempostack-query-frontend-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:17:18.094308 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.094189    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:17:18.094308 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.094198    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw" pod "5f9d27ee-2713-4e83-9f98-bb0ab20300d3" (UID: "5f9d27ee-2713-4e83-9f98-bb0ab20300d3"). InnerVolumeSpecName "kube-api-access-tncbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:17:18.193716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193683    4488 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-storage-gcs-key\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.193716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193716    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.193846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193726    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.193846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193738    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-data-science-tempostack-query-frontend-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.193846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193747    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tncbw\" (UniqueName: \"kubernetes.io/projected/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-kube-api-access-tncbw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.193846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.193756    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f9d27ee-2713-4e83-9f98-bb0ab20300d3-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:18.992225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.992199    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"
Oct 30 11:17:18.992633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.992197    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9" event={"ID":"5f9d27ee-2713-4e83-9f98-bb0ab20300d3","Type":"ContainerDied","Data":"708a55ae24cb6a0c09456ece7cb05fa88b03ed904a15a4f1dd6d13c9d8b0c0ef"}
Oct 30 11:17:18.992633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:18.992333    4488 scope.go:122] "RemoveContainer" containerID="771cecf315a72fb78a6cadb6d7cb123e41931e9685671382b1cdeb6a4a377a72"
Oct 30 11:17:19.053403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:19.053382    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:17:19.066540 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:19.066516    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-748b86b768-hjgw9"]
Oct 30 11:17:19.805642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:19.805612    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" path="/var/lib/kubelet/pods/5f9d27ee-2713-4e83-9f98-bb0ab20300d3/volumes"
Oct 30 11:17:26.765463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:26.765434    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:17:29.829466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:29.829432    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:17:29.829856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:29.829628    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo" containerID="cri-o://59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1" gracePeriod=30
Oct 30 11:17:31.365132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.365108    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:17:31.478283 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:31.478201    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:17:31.497561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497535    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.497691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497598    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\" (UniqueName: \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.497691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497619    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.497691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497661    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.497691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497683    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.497895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.497775    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\") pod \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\" (UID: \"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33\") "
Oct 30 11:17:31.498106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.498057    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:17:31.498198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.498106    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:17:31.498198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.498165    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:31.498305 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.498218    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:17:31.499685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.499637    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "kube-api-access-rhx7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:17:31.499799 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.499784    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:17:31.499858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.499837    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls" pod "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" (UID: "e4f6348f-94a5-4b98-bfb0-9a306c1a3f33"). InnerVolumeSpecName "tempo-data-science-tempostack-compactor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:17:31.599103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.599080    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:31.599103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.599100    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhx7h\" (UniqueName: \"kubernetes.io/projected/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-kube-api-access-rhx7h\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:31.599235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.599110    4488 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-storage-gcs-key\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:31.599235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.599120    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:31.599235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:31.599129    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33-tempo-data-science-tempostack-compactor-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:17:32.049944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.049910    4488 generic.go:356] "Generic (PLEG): container finished" podID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerID="59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1" exitCode=0
Oct 30 11:17:32.050097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.049960    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"
Oct 30 11:17:32.050097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.049994    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" event={"ID":"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33","Type":"ContainerDied","Data":"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"}
Oct 30 11:17:32.050097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.050051    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx" event={"ID":"e4f6348f-94a5-4b98-bfb0-9a306c1a3f33","Type":"ContainerDied","Data":"1358e8d9a4dbfc2645e0f3913abd47085a229a9fa93e164b59d8639a49274441"}
Oct 30 11:17:32.050097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.050077    4488 scope.go:122] "RemoveContainer" containerID="59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"
Oct 30 11:17:32.058208 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.058191    4488 scope.go:122] "RemoveContainer" containerID="3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"
Oct 30 11:17:32.065211 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.065194    4488 scope.go:122] "RemoveContainer" containerID="59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"
Oct 30 11:17:32.065497 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:32.065477    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1\": container with ID starting with 59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1 not found: ID does not exist" containerID="59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"
Oct 30 11:17:32.065549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.065506    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1"} err="failed to get container status \"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1\": rpc error: code = NotFound desc = could not find container \"59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1\": container with ID starting with 59c4a8bdfae68a98909541c82da2e75a414398d252f73f8bf211c1326406e9f1 not found: ID does not exist"
Oct 30 11:17:32.065549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.065525    4488 scope.go:122] "RemoveContainer" containerID="3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"
Oct 30 11:17:32.065784 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:17:32.065763    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915\": container with ID starting with 3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915 not found: ID does not exist" containerID="3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"
Oct 30 11:17:32.065823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.065789    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915"} err="failed to get container status \"3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915\": rpc error: code = NotFound desc = could not find container \"3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915\": container with ID starting with 3e90b59e9b26acaa649cb23215e73009fc52917d152b5f7bc0d279ed936ed915 not found: ID does not exist"
Oct 30 11:17:32.106844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.106821    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:17:32.121170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:32.121144    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-5bc8c7bdbc-d8lpx"]
Oct 30 11:17:33.802734 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:17:33.802700    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" path="/var/lib/kubelet/pods/e4f6348f-94a5-4b98-bfb0-9a306c1a3f33/volumes"
Oct 30 11:18:01.477911 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:01.477870    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:18:04.510804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:04.510764    4488 scope.go:122] "RemoveContainer" containerID="a891efbd18249e6b185540217c449505222177803fd96494ec907ecb9ef83191"
Oct 30 11:18:04.518530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:04.518506    4488 scope.go:122] "RemoveContainer" containerID="b5923d5c40138e1ed2fcb0e60e784063f06192972681df6bcbbc4c03bce6b24d"
Oct 30 11:18:06.964543 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:06.964510    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:06.965044 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:06.964706    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="f983f4f6-90b2-47b3-b856-5646c00faf9b" containerName="perses" containerID="cri-o://5e909047a6fca3f703fbb603932f013d6e64ad2fb1018a9f0f80a5dac9c810a0" gracePeriod=30
Oct 30 11:18:07.192528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.192494    4488 generic.go:356] "Generic (PLEG): container finished" podID="f983f4f6-90b2-47b3-b856-5646c00faf9b" containerID="5e909047a6fca3f703fbb603932f013d6e64ad2fb1018a9f0f80a5dac9c810a0" exitCode=0
Oct 30 11:18:07.192680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.192567    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f983f4f6-90b2-47b3-b856-5646c00faf9b","Type":"ContainerDied","Data":"5e909047a6fca3f703fbb603932f013d6e64ad2fb1018a9f0f80a5dac9c810a0"}
Oct 30 11:18:07.217831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.217780    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:07.363728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.363030    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\" (UniqueName: \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\") pod \"f983f4f6-90b2-47b3-b856-5646c00faf9b\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") "
Oct 30 11:18:07.363728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.363168    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"f983f4f6-90b2-47b3-b856-5646c00faf9b\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") "
Oct 30 11:18:07.363728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.363266    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\" (UniqueName: \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\") pod \"f983f4f6-90b2-47b3-b856-5646c00faf9b\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") "
Oct 30 11:18:07.363728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.363330    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\") pod \"f983f4f6-90b2-47b3-b856-5646c00faf9b\" (UID: \"f983f4f6-90b2-47b3-b856-5646c00faf9b\") "
Oct 30 11:18:07.365302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.365260    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config" pod "f983f4f6-90b2-47b3-b856-5646c00faf9b" (UID: "f983f4f6-90b2-47b3-b856-5646c00faf9b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:07.368024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.367997    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq" pod "f983f4f6-90b2-47b3-b856-5646c00faf9b" (UID: "f983f4f6-90b2-47b3-b856-5646c00faf9b"). InnerVolumeSpecName "kube-api-access-fm4mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:07.368489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.368465    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "f983f4f6-90b2-47b3-b856-5646c00faf9b" (UID: "f983f4f6-90b2-47b3-b856-5646c00faf9b"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:18:07.384095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.384067    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:18:07.384306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.384283    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo" containerID="cri-o://00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682" gracePeriod=30
Oct 30 11:18:07.448706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.448678    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:18:07.448912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.448885    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo" containerID="cri-o://8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63" gracePeriod=30
Oct 30 11:18:07.454072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.454046    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:18:07.454162 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.454107    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:18:07.454279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.454247    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" podUID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" containerName="tempo" containerID="cri-o://50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8" gracePeriod=30
Oct 30 11:18:07.454585 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.454545    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway" containerID="cri-o://54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166" gracePeriod=30
Oct 30 11:18:07.454738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.454588    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway-opa" containerID="cri-o://0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154" gracePeriod=30
Oct 30 11:18:07.464756 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.464731    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm4mq\" (UniqueName: \"kubernetes.io/projected/f983f4f6-90b2-47b3-b856-5646c00faf9b-kube-api-access-fm4mq\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:07.464864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.464779    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:18:07.464864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.464795    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f983f4f6-90b2-47b3-b856-5646c00faf9b-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:07.479589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.479572    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:18:07.543167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.543130    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins" pod "f983f4f6-90b2-47b3-b856-5646c00faf9b" (UID: "f983f4f6-90b2-47b3-b856-5646c00faf9b"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:18:07.565419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.565389    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:18:07.565419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:07.565421    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f983f4f6-90b2-47b3-b856-5646c00faf9b-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.003383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.003351    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 11:18:08.006046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.006024    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 11:18:08.036661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.036638    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:18:08.036814 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.036778    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/fake-gcs-server" podUID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" containerName="fake-gcs-server" containerID="cri-o://d2aa425b20138736788045e29247ce679f7523955315f7bced144032f1282552" gracePeriod=30
Oct 30 11:18:08.199141 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.199109    4488 generic.go:356] "Generic (PLEG): container finished" podID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" containerID="d2aa425b20138736788045e29247ce679f7523955315f7bced144032f1282552" exitCode=0
Oct 30 11:18:08.199279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.199175    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d","Type":"ContainerDied","Data":"d2aa425b20138736788045e29247ce679f7523955315f7bced144032f1282552"}
Oct 30 11:18:08.200616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.200599    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:08.200738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.200625    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f983f4f6-90b2-47b3-b856-5646c00faf9b","Type":"ContainerDied","Data":"1d23d8675c4f9de0f5c59eb736d74f04e05df5ff13994621eb511d473a7fdab2"}
Oct 30 11:18:08.200738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.200673    4488 scope.go:122] "RemoveContainer" containerID="5e909047a6fca3f703fbb603932f013d6e64ad2fb1018a9f0f80a5dac9c810a0"
Oct 30 11:18:08.202788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.202762    4488 generic.go:356] "Generic (PLEG): container finished" podID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerID="0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154" exitCode=0
Oct 30 11:18:08.202903 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.202798    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerDied","Data":"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"}
Oct 30 11:18:08.257771 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.257746    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:08.261635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.261611    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:08.284880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.284859    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:18:08.471805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.471780    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\") pod \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") "
Oct 30 11:18:08.471983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.471843    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\" (UniqueName: \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\") pod \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\" (UID: \"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d\") "
Oct 30 11:18:08.472158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.472135    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data" pod "1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" (UID: "1c63551f-6ac5-4214-bd8e-a15a5cc3a38d"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:18:08.473731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.473714    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5" pod "1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" (UID: "1c63551f-6ac5-4214-bd8e-a15a5cc3a38d"). InnerVolumeSpecName "kube-api-access-x58w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:08.572918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.572897    4488 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-data\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.572999 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.572920    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x58w5\" (UniqueName: \"kubernetes.io/projected/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d-kube-api-access-x58w5\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.692219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.692196    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:18:08.875744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875677    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\" (UniqueName: \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.875744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875721    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.875956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875770    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.875956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875786    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.875956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875809    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.875956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875847    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.876160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.875945    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\") pod \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\" (UID: \"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69\") "
Oct 30 11:18:08.876259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.876228    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:08.876259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.876232    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:08.876634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.876609    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:08.877873 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.877848    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "kube-api-access-c7kj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:08.877958 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.877929    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "tempo-data-science-tempostack-gateway-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:08.878280 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.878258    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "serving-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:08.881487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.881467    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant" pod "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" (UID: "c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69"). InnerVolumeSpecName "tenant". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:08.977393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977369    4488 reconciler_common.go:299] "Volume detached for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tenant\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977394    4488 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977407    4488 reconciler_common.go:299] "Volume detached for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977424    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977438    4488 reconciler_common.go:299] "Volume detached for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-serving-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977452    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-tempo-data-science-tempostack-gateway-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:08.977514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:08.977465    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7kj9\" (UniqueName: \"kubernetes.io/projected/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69-kube-api-access-c7kj9\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.208740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.208708    4488 generic.go:356] "Generic (PLEG): container finished" podID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerID="54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166" exitCode=0
Oct 30 11:18:09.209175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.208762    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"
Oct 30 11:18:09.209175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.208783    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerDied","Data":"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"}
Oct 30 11:18:09.209175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.208836    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6" event={"ID":"c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69","Type":"ContainerDied","Data":"a021443216530c4dc1b6f7ec8de689ab449cca037a18f67847d380acb8025c10"}
Oct 30 11:18:09.209175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.208861    4488 scope.go:122] "RemoveContainer" containerID="0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"
Oct 30 11:18:09.210294 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.210264    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 11:18:09.210294 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.210283    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"1c63551f-6ac5-4214-bd8e-a15a5cc3a38d","Type":"ContainerDied","Data":"58bce62869b832a4fa3ce36deafd3cfbfb22591d1749c72975a2bcef6d110e13"}
Oct 30 11:18:09.217434 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.217420    4488 scope.go:122] "RemoveContainer" containerID="54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"
Oct 30 11:18:09.225093 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.225079    4488 scope.go:122] "RemoveContainer" containerID="0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"
Oct 30 11:18:09.225336 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:09.225316    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154\": container with ID starting with 0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154 not found: ID does not exist" containerID="0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"
Oct 30 11:18:09.225414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.225360    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154"} err="failed to get container status \"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154\": rpc error: code = NotFound desc = could not find container \"0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154\": container with ID starting with 0afd776bce3cb55efa6b59338e265f45b574e0fcdce5a0f2add44091e18e0154 not found: ID does not exist"
Oct 30 11:18:09.225414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.225377    4488 scope.go:122] "RemoveContainer" containerID="54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"
Oct 30 11:18:09.225656 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:09.225636    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166\": container with ID starting with 54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166 not found: ID does not exist" containerID="54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"
Oct 30 11:18:09.225705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.225662    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166"} err="failed to get container status \"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166\": rpc error: code = NotFound desc = could not find container \"54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166\": container with ID starting with 54b6a32c50e12fd275f10773bd5185cef21fc1b022ad2eee33f83cd65f1ab166 not found: ID does not exist"
Oct 30 11:18:09.225705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.225679    4488 scope.go:122] "RemoveContainer" containerID="d2aa425b20138736788045e29247ce679f7523955315f7bced144032f1282552"
Oct 30 11:18:09.265007 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.264985    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:18:09.266897 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.266878    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 11:18:09.306380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.306360    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:18:09.320513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.320487    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-85cb9dffcc-nvsf6"]
Oct 30 11:18:09.641527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.641505    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:18:09.646004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.645986    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:18:09.783568 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783507    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.783568 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783544    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\" (UniqueName: \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\") pod \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") "
Oct 30 11:18:09.783727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783593    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\") pod \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") "
Oct 30 11:18:09.783727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783622    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\") pod \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") "
Oct 30 11:18:09.783727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783652    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.783845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783780    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\") pod \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") "
Oct 30 11:18:09.783845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783830    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\") pod \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\" (UID: \"c0294900-5d8a-4daf-b27a-8fa12b1ea088\") "
Oct 30 11:18:09.783944 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783885    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.784002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.783988    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.784057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784002    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:09.784057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784023    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.784156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784064    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\") pod \"53113049-0495-4c61-a839-5d4723efa780\" (UID: \"53113049-0495-4c61-a839-5d4723efa780\") "
Oct 30 11:18:09.784156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784129    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle" pod "c0294900-5d8a-4daf-b27a-8fa12b1ea088" (UID: "c0294900-5d8a-4daf-b27a-8fa12b1ea088"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:09.784393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784277    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage" pod "c0294900-5d8a-4daf-b27a-8fa12b1ea088" (UID: "c0294900-5d8a-4daf-b27a-8fa12b1ea088"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:18:09.784393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784329    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.784393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784382    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.784589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784487    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:09.784758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.784714    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf" pod "c0294900-5d8a-4daf-b27a-8fa12b1ea088" (UID: "c0294900-5d8a-4daf-b27a-8fa12b1ea088"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:09.786088 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.786063    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "kube-api-access-xbskc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:09.786281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.786259    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls" pod "c0294900-5d8a-4daf-b27a-8fa12b1ea088" (UID: "c0294900-5d8a-4daf-b27a-8fa12b1ea088"). InnerVolumeSpecName "tempo-data-science-tempostack-distributor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:09.786393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.786290    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj" pod "c0294900-5d8a-4daf-b27a-8fa12b1ea088" (UID: "c0294900-5d8a-4daf-b27a-8fa12b1ea088"). InnerVolumeSpecName "kube-api-access-2x2tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:09.786716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.786688    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "tempo-data-science-tempostack-ingester-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:09.787017 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.786998    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:09.787085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.787055    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4" pod "53113049-0495-4c61-a839-5d4723efa780" (UID: "53113049-0495-4c61-a839-5d4723efa780"). InnerVolumeSpecName "pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:18:09.802560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.802539    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" path="/var/lib/kubelet/pods/1c63551f-6ac5-4214-bd8e-a15a5cc3a38d/volumes"
Oct 30 11:18:09.802852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.802840    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ecd32ff-0425-42d5-bc34-48d02d0788d7" path="/var/lib/kubelet/pods/8ecd32ff-0425-42d5-bc34-48d02d0788d7/volumes"
Oct 30 11:18:09.803174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.803162    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" path="/var/lib/kubelet/pods/c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69/volumes"
Oct 30 11:18:09.803888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.803872    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f983f4f6-90b2-47b3-b856-5646c00faf9b" path="/var/lib/kubelet/pods/f983f4f6-90b2-47b3-b856-5646c00faf9b/volumes"
Oct 30 11:18:09.885300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885276    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x2tj\" (UniqueName: \"kubernetes.io/projected/c0294900-5d8a-4daf-b27a-8fa12b1ea088-kube-api-access-2x2tj\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885298    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-data-science-tempostack-distributor-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885308    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbskc\" (UniqueName: \"kubernetes.io/projected/53113049-0495-4c61-a839-5d4723efa780-kube-api-access-xbskc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885317    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885325    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c0294900-5d8a-4daf-b27a-8fa12b1ea088-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885334    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885379    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885388    4488 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-storage-gcs-key\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.885472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.885397    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ingester-mtls\" (UniqueName: \"kubernetes.io/secret/53113049-0495-4c61-a839-5d4723efa780-tempo-data-science-tempostack-ingester-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:09.893479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.893467    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:18:09.986441 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:09.986422    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-aedcdca3-95dc-4504-a60a-a57d130b1e02\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4fd50f939667bd4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-4d7328022bfc04cafd97424f1ef455357ed8326ede74ab5404fd6354555574d5\""
Oct 30 11:18:10.220911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.220876    4488 generic.go:356] "Generic (PLEG): container finished" podID="53113049-0495-4c61-a839-5d4723efa780" containerID="00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682" exitCode=0
Oct 30 11:18:10.221374 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.220919    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"
Oct 30 11:18:10.221374 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.220961    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" event={"ID":"53113049-0495-4c61-a839-5d4723efa780","Type":"ContainerDied","Data":"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"}
Oct 30 11:18:10.221374 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.221013    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0" event={"ID":"53113049-0495-4c61-a839-5d4723efa780","Type":"ContainerDied","Data":"bdaca958c7f478e15e3d8c92bb37f76dc4f759eb4a13c3adc9ee7a51e5fe9bc0"}
Oct 30 11:18:10.221374 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.221036    4488 scope.go:122] "RemoveContainer" containerID="00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"
Oct 30 11:18:10.222578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.222557    4488 generic.go:356] "Generic (PLEG): container finished" podID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" containerID="50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8" exitCode=0
Oct 30 11:18:10.222808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.222606    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"
Oct 30 11:18:10.222808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.222620    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" event={"ID":"c0294900-5d8a-4daf-b27a-8fa12b1ea088","Type":"ContainerDied","Data":"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"}
Oct 30 11:18:10.222808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.222677    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp" event={"ID":"c0294900-5d8a-4daf-b27a-8fa12b1ea088","Type":"ContainerDied","Data":"8d9200539eee6c2fbc752de164219425ee1c32d9063387b52f2dd85b8ff95e6f"}
Oct 30 11:18:10.228878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.228858    4488 scope.go:122] "RemoveContainer" containerID="00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"
Oct 30 11:18:10.229138 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:10.229119    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682\": container with ID starting with 00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682 not found: ID does not exist" containerID="00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"
Oct 30 11:18:10.229202 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.229144    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682"} err="failed to get container status \"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682\": rpc error: code = NotFound desc = could not find container \"00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682\": container with ID starting with 00863a0b0f616a6fb121150743735a9429ff73d921371306290b77421bd35682 not found: ID does not exist"
Oct 30 11:18:10.229202 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.229164    4488 scope.go:122] "RemoveContainer" containerID="50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"
Oct 30 11:18:10.236245 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.236230    4488 scope.go:122] "RemoveContainer" containerID="50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"
Oct 30 11:18:10.236639 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:10.236616    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8\": container with ID starting with 50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8 not found: ID does not exist" containerID="50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"
Oct 30 11:18:10.236712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.236642    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8"} err="failed to get container status \"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8\": rpc error: code = NotFound desc = could not find container \"50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8\": container with ID starting with 50f70bdec8f721e62fa039b5bbd4475f7a7f060ef45bf44a6fae32a34d9792f8 not found: ID does not exist"
Oct 30 11:18:10.283469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.283442    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:18:10.297518 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.297493    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-ingester-0"]
Oct 30 11:18:10.324242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.324223    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:18:10.331031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:10.331010    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5b7dbb9cdb-vxkmp"]
Oct 30 11:18:11.803037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.803001    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53113049-0495-4c61-a839-5d4723efa780" path="/var/lib/kubelet/pods/53113049-0495-4c61-a839-5d4723efa780/volumes"
Oct 30 11:18:11.803489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.803472    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" path="/var/lib/kubelet/pods/c0294900-5d8a-4daf-b27a-8fa12b1ea088/volumes"
Oct 30 11:18:11.931001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.930970    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:11.931329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931312    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931331    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931357    4488 cpu_manager.go:414] "containerMap: removing container" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931365    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931386    4488 cpu_manager.go:414] "containerMap: removing container" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931394    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931420    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway-opa"
Oct 30 11:18:11.931439 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931428    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway-opa"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931443    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931450    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931467    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f983f4f6-90b2-47b3-b856-5646c00faf9b" containerName="perses"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931474    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f983f4f6-90b2-47b3-b856-5646c00faf9b" containerName="perses"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931484    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931490    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931504    4488 cpu_manager.go:414] "containerMap: removing container" podUID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" containerName="fake-gcs-server"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931511    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" containerName="fake-gcs-server"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931521    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931529    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931606    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f9d27ee-2713-4e83-9f98-bb0ab20300d3" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931621    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway-opa"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931631    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931639    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f983f4f6-90b2-47b3-b856-5646c00faf9b" containerName="perses"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931648    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0294900-5d8a-4daf-b27a-8fa12b1ea088" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931656    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c63551f-6ac5-4214-bd8e-a15a5cc3a38d" containerName="fake-gcs-server"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931664    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0ee5d0f-7210-4e3d-b4b1-aeec61aa4e69" containerName="tempo-gateway"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931672    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4f6348f-94a5-4b98-bfb0-9a306c1a3f33" containerName="tempo"
Oct 30 11:18:11.931790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.931679    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="53113049-0495-4c61-a839-5d4723efa780" containerName="tempo"
Oct 30 11:18:11.936460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.936439    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:11.945589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.945563    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:11.948697 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.948679    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:11.963030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.963007    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:11.971215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:11.971191    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:12.015570 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.015546    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:18:12.015702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.015605    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-61f7caf9\""
Oct 30 11:18:12.021526 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.021506    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:18:12.021616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.021579    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:18:12.021691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.021678    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-prh6t\""
Oct 30 11:18:12.099375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099289    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.099375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099322    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd24q\" (UniqueName: \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.099375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099356    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.099593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099482    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.099593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099578    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.099669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.099614    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2sll\" (UniqueName: \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.200503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200477    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.200615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200517    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd24q\" (UniqueName: \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.200615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200558    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.200615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200586    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.200780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200736    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.200848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200800    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2sll\" (UniqueName: \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.200971 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.200948    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.201237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.201217    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.201459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.201440    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.203216 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.203194    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.225248 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.225230    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd24q\" (UniqueName: \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:12.225575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.225555    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2sll\" (UniqueName: \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\") pod \"data-science-collector-collector-1\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.249982 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.249962    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:12.547086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.547057    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:12.549792 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:12.549768    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5917713_09cb_4a42_ab83_c2e4482cbcbe.slice/crio-746f8f813421eb4ca9d775694a54572ab51cf8ee3d1d79ef557885136e0bcb94 WatchSource:0}: Error finding container 746f8f813421eb4ca9d775694a54572ab51cf8ee3d1d79ef557885136e0bcb94: Status 404 returned error can't find the container with id 746f8f813421eb4ca9d775694a54572ab51cf8ee3d1d79ef557885136e0bcb94
Oct 30 11:18:12.551723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.551686    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:12.551790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.551766    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:12.635985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.635952    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:12.639810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.639786    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.656201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.656178    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-serving-cabundle\""
Oct 30 11:18:12.656334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.656314    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-config\""
Oct 30 11:18:12.657166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657135    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-ca-bundle\""
Oct 30 11:18:12.657279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657261    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway-serving-cert\""
Oct 30 11:18:12.657370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657313    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-6wst6\""
Oct 30 11:18:12.657370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657314    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:18:12.657476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657460    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-mtls\""
Oct 30 11:18:12.657629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.657612    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:18:12.663719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.663694    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:12.704547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704513    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704557    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704709    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704771    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704803    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704860 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704823    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704860 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704846    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m44p6\" (UniqueName: \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.704926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.704902    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805272    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m44p6\" (UniqueName: \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805304    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805334    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805371    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805451    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805482    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805501    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.805823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.805525    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.806138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.806045    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.806138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.806122    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.806608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.806583    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.806697 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.806609    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.807903 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.807884    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.808472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.808447    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.808659 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.808448    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:12.830661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:12.830642    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m44p6\" (UniqueName: \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:13.242219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:13.242190    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"b5917713-09cb-4a42-ab83-c2e4482cbcbe","Type":"ContainerStarted","Data":"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"}
Oct 30 11:18:13.242370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:13.242251    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"b5917713-09cb-4a42-ab83-c2e4482cbcbe","Type":"ContainerStarted","Data":"746f8f813421eb4ca9d775694a54572ab51cf8ee3d1d79ef557885136e0bcb94"}
Oct 30 11:18:13.288705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:13.288661    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.288650117 podStartE2EDuration="2.288650117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:13.287458104 +0000 UTC m=+1989.633049979" watchObservedRunningTime="2026-10-30 11:18:13.288650117 +0000 UTC m=+1989.634241950"
Oct 30 11:18:15.759809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:15.759773    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:18:22.479575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.479544    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.480004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.479604    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.513649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.513629    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.513756 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.513658    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.580768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.580744    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.580868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.580790    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.580907 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.580872    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.580971 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.580871    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.597239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.597217    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.597323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.597305    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.701175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.701144    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.701652 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.701625    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fd3ed81014d76a975b5ba6f044c00684e55bfb3daddf6ff0e225ceff74c57792/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.729849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.729792    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:22.732839 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.732820    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.761083 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.761060    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:22.857912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:22.857873    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:23.057709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.057686    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:23.059728 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:23.059701    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73a861d9_675e_4588_9534_822089c3bba3.slice/crio-15629ab5c2b66fdfe33632c0eb5a1026cd8d33167b3b036357398424a348d199 WatchSource:0}: Error finding container 15629ab5c2b66fdfe33632c0eb5a1026cd8d33167b3b036357398424a348d199: Status 404 returned error can't find the container with id 15629ab5c2b66fdfe33632c0eb5a1026cd8d33167b3b036357398424a348d199
Oct 30 11:18:23.175040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.175009    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:23.178148 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:23.178123    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb179a215_3e9f_47d2_b544_3065ea3822a4.slice/crio-47f5beff7ca652e1e1fb8a9b94b4456795ecaedffc4518d545257712a39f07b9 WatchSource:0}: Error finding container 47f5beff7ca652e1e1fb8a9b94b4456795ecaedffc4518d545257712a39f07b9: Status 404 returned error can't find the container with id 47f5beff7ca652e1e1fb8a9b94b4456795ecaedffc4518d545257712a39f07b9
Oct 30 11:18:23.287657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.287554    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73a861d9-675e-4588-9534-822089c3bba3","Type":"ContainerStarted","Data":"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"}
Oct 30 11:18:23.287657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.287610    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:23.287657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.287630    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73a861d9-675e-4588-9534-822089c3bba3","Type":"ContainerStarted","Data":"15629ab5c2b66fdfe33632c0eb5a1026cd8d33167b3b036357398424a348d199"}
Oct 30 11:18:23.289874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.289844    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerStarted","Data":"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"}
Oct 30 11:18:23.289994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.289904    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerStarted","Data":"47f5beff7ca652e1e1fb8a9b94b4456795ecaedffc4518d545257712a39f07b9"}
Oct 30 11:18:23.333528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:23.333473    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=12.333453399 podStartE2EDuration="12.333453399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:23.331817504 +0000 UTC m=+1999.677409374" watchObservedRunningTime="2026-10-30 11:18:23.333453399 +0000 UTC m=+1999.679045254"
Oct 30 11:18:24.296905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:24.296870    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerStarted","Data":"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"}
Oct 30 11:18:24.297385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:24.296935    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerStarted","Data":"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"}
Oct 30 11:18:24.297385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:24.297173    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:24.307184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:24.307160    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:24.376160 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:24.376114    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podStartSLOduration=12.376098942 podStartE2EDuration="12.376098942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:24.361353156 +0000 UTC m=+2000.706945001" watchObservedRunningTime="2026-10-30 11:18:24.376098942 +0000 UTC m=+2000.721690797"
Oct 30 11:18:25.301675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:25.301641    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:25.302139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:25.301707    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:25.303360 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:25.303314    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:25.759850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:25.759818    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:18:29.508183 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.508150    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:29.508673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.508420    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" containerName="otc-container" containerID="cri-o://71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a" gracePeriod=30
Oct 30 11:18:29.649082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.649049    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:29.649513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.649249    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="73a861d9-675e-4588-9534-822089c3bba3" containerName="perses" containerID="cri-o://2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f" gracePeriod=30
Oct 30 11:18:29.774613 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.774590    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:29.840819 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.840785    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\" (UniqueName: \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\") pod \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") "
Oct 30 11:18:29.840987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.840864    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\" (UniqueName: \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\") pod \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") "
Oct 30 11:18:29.840987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.840914    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\") pod \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\" (UID: \"b5917713-09cb-4a42-ab83-c2e4482cbcbe\") "
Oct 30 11:18:29.841358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.841319    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal" pod "b5917713-09cb-4a42-ab83-c2e4482cbcbe" (UID: "b5917713-09cb-4a42-ab83-c2e4482cbcbe"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:29.845761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.845662    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll" pod "b5917713-09cb-4a42-ab83-c2e4482cbcbe" (UID: "b5917713-09cb-4a42-ab83-c2e4482cbcbe"). InnerVolumeSpecName "kube-api-access-m2sll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:29.845916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.845885    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs" pod "b5917713-09cb-4a42-ab83-c2e4482cbcbe" (UID: "b5917713-09cb-4a42-ab83-c2e4482cbcbe"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:29.891385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.891359    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:29.941900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.941868    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\" (UniqueName: \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\") pod \"73a861d9-675e-4588-9534-822089c3bba3\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") "
Oct 30 11:18:29.942069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942006    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"73a861d9-675e-4588-9534-822089c3bba3\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") "
Oct 30 11:18:29.942175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942157    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\" (UniqueName: \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\") pod \"73a861d9-675e-4588-9534-822089c3bba3\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") "
Oct 30 11:18:29.942256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942195    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\" (UniqueName: \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\") pod \"73a861d9-675e-4588-9534-822089c3bba3\" (UID: \"73a861d9-675e-4588-9534-822089c3bba3\") "
Oct 30 11:18:29.942534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942516    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b5917713-09cb-4a42-ab83-c2e4482cbcbe-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:29.942638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942572    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5917713-09cb-4a42-ab83-c2e4482cbcbe-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:29.942638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.942587    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2sll\" (UniqueName: \"kubernetes.io/projected/b5917713-09cb-4a42-ab83-c2e4482cbcbe-kube-api-access-m2sll\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:29.945547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.945521    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config" pod "73a861d9-675e-4588-9534-822089c3bba3" (UID: "73a861d9-675e-4588-9534-822089c3bba3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:29.946771 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.946740    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q" pod "73a861d9-675e-4588-9534-822089c3bba3" (UID: "73a861d9-675e-4588-9534-822089c3bba3"). InnerVolumeSpecName "kube-api-access-hd24q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:29.957943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.957896    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "73a861d9-675e-4588-9534-822089c3bba3" (UID: "73a861d9-675e-4588-9534-822089c3bba3"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:18:29.959902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.959844    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:29.960314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.960091    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo" containerID="cri-o://177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76" gracePeriod=30
Oct 30 11:18:29.960314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.960159    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway-opa" containerID="cri-o://4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90" gracePeriod=30
Oct 30 11:18:29.960314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:29.960227    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway" containerID="cri-o://b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7" gracePeriod=30
Oct 30 11:18:30.043126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.043055    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:18:30.043126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.043080    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73a861d9-675e-4588-9534-822089c3bba3-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:30.043126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.043092    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd24q\" (UniqueName: \"kubernetes.io/projected/73a861d9-675e-4588-9534-822089c3bba3-kube-api-access-hd24q\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:30.053804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.053780    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:18:30.098827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.098802    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins" pod "73a861d9-675e-4588-9534-822089c3bba3" (UID: "73a861d9-675e-4588-9534-822089c3bba3"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:18:30.144181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.144159    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73a861d9-675e-4588-9534-822089c3bba3-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:30.144272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.144188    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:18:30.302636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.302570    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.120:8083/ready\": dial tcp 10.133.0.120:8083: connect: connection refused"
Oct 30 11:18:30.323751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.323726    4488 generic.go:356] "Generic (PLEG): container finished" podID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" containerID="71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a" exitCode=0
Oct 30 11:18:30.323863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.323791    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:30.323863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.323814    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"b5917713-09cb-4a42-ab83-c2e4482cbcbe","Type":"ContainerDied","Data":"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"}
Oct 30 11:18:30.323977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.323905    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"b5917713-09cb-4a42-ab83-c2e4482cbcbe","Type":"ContainerDied","Data":"746f8f813421eb4ca9d775694a54572ab51cf8ee3d1d79ef557885136e0bcb94"}
Oct 30 11:18:30.323977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.323938    4488 scope.go:122] "RemoveContainer" containerID="71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"
Oct 30 11:18:30.325286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.325262    4488 generic.go:356] "Generic (PLEG): container finished" podID="73a861d9-675e-4588-9534-822089c3bba3" containerID="2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f" exitCode=0
Oct 30 11:18:30.325367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.325337    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:30.325426 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.325367    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73a861d9-675e-4588-9534-822089c3bba3","Type":"ContainerDied","Data":"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"}
Oct 30 11:18:30.325426 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.325421    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73a861d9-675e-4588-9534-822089c3bba3","Type":"ContainerDied","Data":"15629ab5c2b66fdfe33632c0eb5a1026cd8d33167b3b036357398424a348d199"}
Oct 30 11:18:30.328048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.328025    4488 generic.go:356] "Generic (PLEG): container finished" podID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerID="4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90" exitCode=0
Oct 30 11:18:30.328048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.328046    4488 generic.go:356] "Generic (PLEG): container finished" podID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerID="177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76" exitCode=0
Oct 30 11:18:30.328184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.328070    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerDied","Data":"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"}
Oct 30 11:18:30.328184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.328113    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerDied","Data":"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"}
Oct 30 11:18:30.333475 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.333454    4488 scope.go:122] "RemoveContainer" containerID="71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"
Oct 30 11:18:30.333756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:30.333734    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a\": container with ID starting with 71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a not found: ID does not exist" containerID="71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"
Oct 30 11:18:30.333813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.333763    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a"} err="failed to get container status \"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a\": rpc error: code = NotFound desc = could not find container \"71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a\": container with ID starting with 71401993c4d6ad440aa0812c2643bab2d2ad18259c7de1aad08f12145d722b5a not found: ID does not exist"
Oct 30 11:18:30.333813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.333780    4488 scope.go:122] "RemoveContainer" containerID="2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"
Oct 30 11:18:30.341063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.341048    4488 scope.go:122] "RemoveContainer" containerID="2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"
Oct 30 11:18:30.341310 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:30.341296    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f\": container with ID starting with 2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f not found: ID does not exist" containerID="2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"
Oct 30 11:18:30.341369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.341317    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f"} err="failed to get container status \"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f\": rpc error: code = NotFound desc = could not find container \"2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f\": container with ID starting with 2dd91150c42822bdc904c16c6ed11569dd714956475ccf2f35d291fec9ecf94f not found: ID does not exist"
Oct 30 11:18:30.381152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.381123    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:30.387867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.387849    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:30.425943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.425918    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:30.430221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:30.430194    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:31.216828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.216803    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:31.334682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.334613    4488 generic.go:356] "Generic (PLEG): container finished" podID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerID="b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7" exitCode=0
Oct 30 11:18:31.334682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.334668    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:18:31.334876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.334699    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerDied","Data":"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"}
Oct 30 11:18:31.334876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.334761    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"b179a215-3e9f-47d2-b544-3065ea3822a4","Type":"ContainerDied","Data":"47f5beff7ca652e1e1fb8a9b94b4456795ecaedffc4518d545257712a39f07b9"}
Oct 30 11:18:31.334876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.334800    4488 scope.go:122] "RemoveContainer" containerID="4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"
Oct 30 11:18:31.342671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.342654    4488 scope.go:122] "RemoveContainer" containerID="b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"
Oct 30 11:18:31.349967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.349950    4488 scope.go:122] "RemoveContainer" containerID="177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"
Oct 30 11:18:31.354639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354619    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354668    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354709    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354748    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\" (UniqueName: \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354839    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354921    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354950    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.354988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354969    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.355098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.354988    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\") pod \"b179a215-3e9f-47d2-b544-3065ea3822a4\" (UID: \"b179a215-3e9f-47d2-b544-3065ea3822a4\") "
Oct 30 11:18:31.355150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.355100    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-serving-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:31.355256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.355241    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-serving-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.355487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.355453    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "gateway-rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:31.355487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.355478    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:31.356143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.356036    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:31.356954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.356927    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "gateway-tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:31.357254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.357235    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:31.357480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.357308    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-gateway-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:31.357480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.357381    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "kube-api-access-m44p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:31.358394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.358374    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e" pod "b179a215-3e9f-47d2-b544-3065ea3822a4" (UID: "b179a215-3e9f-47d2-b544-3065ea3822a4"). InnerVolumeSpecName "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:18:31.359300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.359285    4488 scope.go:122] "RemoveContainer" containerID="4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"
Oct 30 11:18:31.359598 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:31.359581    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90\": container with ID starting with 4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90 not found: ID does not exist" containerID="4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"
Oct 30 11:18:31.359666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.359608    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90"} err="failed to get container status \"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90\": rpc error: code = NotFound desc = could not find container \"4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90\": container with ID starting with 4a57df5e1a45c46f45a837b70465ef5072ca834b37f0a66ef9743a9d6eef4c90 not found: ID does not exist"
Oct 30 11:18:31.359666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.359631    4488 scope.go:122] "RemoveContainer" containerID="b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"
Oct 30 11:18:31.359898 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:31.359873    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7\": container with ID starting with b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7 not found: ID does not exist" containerID="b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"
Oct 30 11:18:31.359947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.359908    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7"} err="failed to get container status \"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7\": rpc error: code = NotFound desc = could not find container \"b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7\": container with ID starting with b314e47c0011bea748b2be93b169023d78bdf962c84dfe56ef337124cefedec7 not found: ID does not exist"
Oct 30 11:18:31.359947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.359931    4488 scope.go:122] "RemoveContainer" containerID="177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"
Oct 30 11:18:31.360209 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:31.360181    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76\": container with ID starting with 177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76 not found: ID does not exist" containerID="177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"
Oct 30 11:18:31.360262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.360206    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76"} err="failed to get container status \"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76\": rpc error: code = NotFound desc = could not find container \"177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76\": container with ID starting with 177a6e6e4245b900cb37dbb105ad0966c3b59d0ee675fb92c4d1548359fccb76 not found: ID does not exist"
Oct 30 11:18:31.456038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456013    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-gateway-serving-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456057    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456073    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456086    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456098    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456111    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-gateway-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456126    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/b179a215-3e9f-47d2-b544-3065ea3822a4-tempo-data-science-tempomonolithic-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.456150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.456139    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m44p6\" (UniqueName: \"kubernetes.io/projected/b179a215-3e9f-47d2-b544-3065ea3822a4-kube-api-access-m44p6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:31.464931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.464912    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:18:31.478001 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:31.477974    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:18:31.557316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.557292    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\""
Oct 30 11:18:31.685153 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.685121    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:31.699329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.699305    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:18:31.802278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.802254    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73a861d9-675e-4588-9534-822089c3bba3" path="/var/lib/kubelet/pods/73a861d9-675e-4588-9534-822089c3bba3/volumes"
Oct 30 11:18:31.802695 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.802680    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" path="/var/lib/kubelet/pods/b179a215-3e9f-47d2-b544-3065ea3822a4/volumes"
Oct 30 11:18:31.803116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:31.803105    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" path="/var/lib/kubelet/pods/b5917713-09cb-4a42-ab83-c2e4482cbcbe/volumes"
Oct 30 11:18:34.158614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158583    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158867    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway-opa"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158877    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway-opa"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158893    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158899    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158907    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158912    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158920    4488 cpu_manager.go:414] "containerMap: removing container" podUID="73a861d9-675e-4588-9534-822089c3bba3" containerName="perses"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158924    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73a861d9-675e-4588-9534-822089c3bba3" containerName="perses"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158932    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" containerName="otc-container"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158936    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" containerName="otc-container"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158978    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway-opa"
Oct 30 11:18:34.158981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158988    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo"
Oct 30 11:18:34.159320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158993    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b179a215-3e9f-47d2-b544-3065ea3822a4" containerName="tempo-gateway"
Oct 30 11:18:34.159320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.158999    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="73a861d9-675e-4588-9534-822089c3bba3" containerName="perses"
Oct 30 11:18:34.159320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.159004    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5917713-09cb-4a42-ab83-c2e4482cbcbe" containerName="otc-container"
Oct 30 11:18:34.163496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.163476    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:34.187277 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.187254    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:18:34.188185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.188159    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:34.275970 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.275947    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppzp\" (UniqueName: \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v\" (UID: \"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:34.377200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.377170    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kppzp\" (UniqueName: \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v\" (UID: \"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:34.402589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.402566    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppzp\" (UniqueName: \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v\" (UID: \"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:34.475443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.475419    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:34.769369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:34.769278    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:34.771911 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:34.771884    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e9b51ef_b0ef_4e46_8ad3_f7cb5f3287cc.slice/crio-c4db716f513dc24bd933d839d6f8c5869b4f6e9b4aed5a24c5fbf04d8b7de3d6 WatchSource:0}: Error finding container c4db716f513dc24bd933d839d6f8c5869b4f6e9b4aed5a24c5fbf04d8b7de3d6: Status 404 returned error can't find the container with id c4db716f513dc24bd933d839d6f8c5869b4f6e9b4aed5a24c5fbf04d8b7de3d6
Oct 30 11:18:35.175726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.175697    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:35.179038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.179018    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.190081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.190058    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:35.193662 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.193646    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.202445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.201891    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:35.212533 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.212512    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:35.252405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.252380    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:18:35.255558 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.255544    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.265176 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265155    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:18:35.265270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265194    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:18:35.265270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265206    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:18:35.265270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265242    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:18:35.265421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265379    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-xn2fk\""
Oct 30 11:18:35.265421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.265398    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:18:35.274254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.274236    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:18:35.283674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283653    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.283831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283686    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.283831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283705    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.283831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283731    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.283953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283863    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rlh\" (UniqueName: \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.283953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283903    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpspq\" (UniqueName: \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.284021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.283977    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.284021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.284015    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.356856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.356830    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" event={"ID":"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc","Type":"ContainerStarted","Data":"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"}
Oct 30 11:18:35.356959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.356862    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" event={"ID":"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc","Type":"ContainerStarted","Data":"c4db716f513dc24bd933d839d6f8c5869b4f6e9b4aed5a24c5fbf04d8b7de3d6"}
Oct 30 11:18:35.364930 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.364905    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:18:35.365032 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.365010    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-xg9qm\""
Oct 30 11:18:35.365143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.365130    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:18:35.384596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384569    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rlh\" (UniqueName: \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.384683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384601    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.384683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384630    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.384774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384733    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpspq\" (UniqueName: \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.384827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384770    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.384827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384797    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.384827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384817    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.384974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384842    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.384974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384861    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.384974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384881    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlff8\" (UniqueName: \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.384974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.384967    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.385576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.385549    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.385671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.385571    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.385738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.385702    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.387376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.387338    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.387651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.387633    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.387689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.387652    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.419461 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.419439    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpspq\" (UniqueName: \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:35.419649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.419633    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rlh\" (UniqueName: \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\") pod \"data-science-collector-collector-1\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.485652 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.485582    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.485652 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.485626    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.485814 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.485687    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlff8\" (UniqueName: \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.486329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.486309    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.487752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.487734    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.491609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.491591    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:18:35.513471 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.513452    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlff8\" (UniqueName: \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\") pod \"data-science-collector-targetallocator-7db477fc9c-pbpcw\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.566682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.566648    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:35.759749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.759678    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:18:35.759899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.759776    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:18:35.789887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.789842    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" podStartSLOduration=1.7898295499999999 podStartE2EDuration="1.78982955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:35.40043147 +0000 UTC m=+2011.746023324" watchObservedRunningTime="2026-10-30 11:18:35.78982955 +0000 UTC m=+2012.135421382"
Oct 30 11:18:35.790516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.790494    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:18:35.792800 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:35.792774    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ad2bd9_55b8_41d4_a79f_060f1422c52d.slice/crio-9cd40e2b04e174c024ee9c105eea34fb0c158c707fe478cceb907475d3067e04 WatchSource:0}: Error finding container 9cd40e2b04e174c024ee9c105eea34fb0c158c707fe478cceb907475d3067e04: Status 404 returned error can't find the container with id 9cd40e2b04e174c024ee9c105eea34fb0c158c707fe478cceb907475d3067e04
Oct 30 11:18:35.794988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.794960    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:35.795056 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.795011    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:35.866752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.866730    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:18:35.869515 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:35.869488    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd08d6b85_d611_4d2c_a9e6_e2bc4d65f80e.slice/crio-0bdabe6624435ab09c6f2e674b8f0914c0dbe0148e29e3e7a665b233d61668d4 WatchSource:0}: Error finding container 0bdabe6624435ab09c6f2e674b8f0914c0dbe0148e29e3e7a665b233d61668d4: Status 404 returned error can't find the container with id 0bdabe6624435ab09c6f2e674b8f0914c0dbe0148e29e3e7a665b233d61668d4
Oct 30 11:18:35.871861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.871826    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:35.871932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:35.871895    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:18:36.362625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.362591    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" event={"ID":"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e","Type":"ContainerStarted","Data":"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"}
Oct 30 11:18:36.363081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.362634    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" event={"ID":"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e","Type":"ContainerStarted","Data":"0bdabe6624435ab09c6f2e674b8f0914c0dbe0148e29e3e7a665b233d61668d4"}
Oct 30 11:18:36.363081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.362758    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:36.364312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.364280    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d2ad2bd9-55b8-41d4-a79f-060f1422c52d","Type":"ContainerStarted","Data":"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"}
Oct 30 11:18:36.364462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.364330    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d2ad2bd9-55b8-41d4-a79f-060f1422c52d","Type":"ContainerStarted","Data":"9cd40e2b04e174c024ee9c105eea34fb0c158c707fe478cceb907475d3067e04"}
Oct 30 11:18:36.364874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.364859    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:18:36.407937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.407890    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" podStartSLOduration=1.40787949 podStartE2EDuration="1.40787949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:36.406786307 +0000 UTC m=+2012.752378155" watchObservedRunningTime="2026-10-30 11:18:36.40787949 +0000 UTC m=+2012.753471343"
Oct 30 11:18:36.453554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:36.453507    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.453496191 podStartE2EDuration="1.453496191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:36.451695767 +0000 UTC m=+2012.797287622" watchObservedRunningTime="2026-10-30 11:18:36.453496191 +0000 UTC m=+2012.799088044"
Oct 30 11:18:38.089463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.089439    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:18:38.106580 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106554    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.106690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106589    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.106690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106608    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.106690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106639    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.106848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106820    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\" (UniqueName: \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.106916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106877    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\") pod \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\" (UID: \"7c060877-40ef-4b2e-8908-44f9f8e0eaaf\") "
Oct 30 11:18:38.107018 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106993    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:38.107086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.106992    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:18:38.107086 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.107055    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:18:38.107198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.107175    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.107257 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.107206    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.107257 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.107223    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-tmp-storage\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.108739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.108716    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:38.108842 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.108814    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "kube-api-access-vlrkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:38.108994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.108976    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls" pod "7c060877-40ef-4b2e-8908-44f9f8e0eaaf" (UID: "7c060877-40ef-4b2e-8908-44f9f8e0eaaf"). InnerVolumeSpecName "tempo-data-science-tempostack-querier-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:18:38.208330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.208301    4488 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-storage-gcs-key\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.208330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.208325    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlrkt\" (UniqueName: \"kubernetes.io/projected/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-kube-api-access-vlrkt\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.208330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.208336    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/7c060877-40ef-4b2e-8908-44f9f8e0eaaf-tempo-data-science-tempostack-querier-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:38.377850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.377764    4488 generic.go:356] "Generic (PLEG): container finished" podID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerID="8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63" exitCode=137
Oct 30 11:18:38.377850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.377811    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"
Oct 30 11:18:38.378046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.377850    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" event={"ID":"7c060877-40ef-4b2e-8908-44f9f8e0eaaf","Type":"ContainerDied","Data":"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"}
Oct 30 11:18:38.378046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.377907    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq" event={"ID":"7c060877-40ef-4b2e-8908-44f9f8e0eaaf","Type":"ContainerDied","Data":"fd82ea0166047186c8bbc0d3ddb38e157d32fc1bfafd5256294622398c6e791f"}
Oct 30 11:18:38.378046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.377928    4488 scope.go:122] "RemoveContainer" containerID="8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"
Oct 30 11:18:38.387931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.387912    4488 scope.go:122] "RemoveContainer" containerID="8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"
Oct 30 11:18:38.388209 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:38.388191    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63\": container with ID starting with 8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63 not found: ID does not exist" containerID="8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"
Oct 30 11:18:38.388282 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.388222    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63"} err="failed to get container status \"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63\": rpc error: code = NotFound desc = could not find container \"8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63\": container with ID starting with 8e3fa46458c8efa86e48e2cfb62e69e91f16870248d6ca67987968a025eb1e63 not found: ID does not exist"
Oct 30 11:18:38.436236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.436213    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:18:38.450027 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:38.450005    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-759dff96bd-vwqjq"]
Oct 30 11:18:39.271671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.271638    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:39.272052 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.271794    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" podUID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" containerName="thanos-querier" containerID="cri-o://132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd" gracePeriod=30
Oct 30 11:18:39.511263 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.511241    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:39.618797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.618738    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\" (UniqueName: \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\") pod \"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc\" (UID: \"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc\") "
Oct 30 11:18:39.620722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.620702    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp" pod "8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" (UID: "8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc"). InnerVolumeSpecName "kube-api-access-kppzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:18:39.720222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.720194    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kppzp\" (UniqueName: \"kubernetes.io/projected/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc-kube-api-access-kppzp\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:18:39.802814 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:39.802788    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" path="/var/lib/kubelet/pods/7c060877-40ef-4b2e-8908-44f9f8e0eaaf/volumes"
Oct 30 11:18:40.388780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.388750    4488 generic.go:356] "Generic (PLEG): container finished" podID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" containerID="132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd" exitCode=0
Oct 30 11:18:40.389181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.388796    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"
Oct 30 11:18:40.389181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.388801    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" event={"ID":"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc","Type":"ContainerDied","Data":"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"}
Oct 30 11:18:40.389181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.388921    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v" event={"ID":"8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc","Type":"ContainerDied","Data":"c4db716f513dc24bd933d839d6f8c5869b4f6e9b4aed5a24c5fbf04d8b7de3d6"}
Oct 30 11:18:40.389181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.388944    4488 scope.go:122] "RemoveContainer" containerID="132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"
Oct 30 11:18:40.396927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.396902    4488 scope.go:122] "RemoveContainer" containerID="132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"
Oct 30 11:18:40.397159 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:18:40.397143    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd\": container with ID starting with 132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd not found: ID does not exist" containerID="132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"
Oct 30 11:18:40.397211 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.397175    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd"} err="failed to get container status \"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd\": rpc error: code = NotFound desc = could not find container \"132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd\": container with ID starting with 132881e939e4ec653da7c2b2cd9a6c8af5b4e62774102b3192afdb37cfec20dd not found: ID does not exist"
Oct 30 11:18:40.445049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.445027    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:40.458416 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:40.458394    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-6kp9v"]
Oct 30 11:18:41.802833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:41.802801    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" path="/var/lib/kubelet/pods/8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc/volumes"
Oct 30 11:18:45.359951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.359918    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.392375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.392334    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.460564 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.460539    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.460697 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.460630    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.476574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.476551    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.577484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.577454    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.607992 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.607969    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:45.705535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:45.705516    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:46.003332 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:46.003259    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:18:46.006029 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:18:46.005996    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52a629b1_4549_435d_a374_bc6bcfb81c4e.slice/crio-32b94b441cb4d5db44884ecd3daaa020d4eb1d175fc96cc340c3556e7a60ae3e WatchSource:0}: Error finding container 32b94b441cb4d5db44884ecd3daaa020d4eb1d175fc96cc340c3556e7a60ae3e: Status 404 returned error can't find the container with id 32b94b441cb4d5db44884ecd3daaa020d4eb1d175fc96cc340c3556e7a60ae3e
Oct 30 11:18:46.417378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:46.417263    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"52a629b1-4549-435d-a374-bc6bcfb81c4e","Type":"ContainerStarted","Data":"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"}
Oct 30 11:18:46.417378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:46.417318    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"52a629b1-4549-435d-a374-bc6bcfb81c4e","Type":"ContainerStarted","Data":"32b94b441cb4d5db44884ecd3daaa020d4eb1d175fc96cc340c3556e7a60ae3e"}
Oct 30 11:18:46.417378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:46.417371    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:18:46.462740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:46.462683    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=11.462664394 podStartE2EDuration="11.462664394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:18:46.461112342 +0000 UTC m=+2022.806704217" watchObservedRunningTime="2026-10-30 11:18:46.462664394 +0000 UTC m=+2022.808256249"
Oct 30 11:18:57.426482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:18:57.426448    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:19:01.477609 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:01.477573    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:19:08.426413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.426382    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:08.426860 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.426597    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" containerName="otc-container" containerID="cri-o://d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4" gracePeriod=30
Oct 30 11:19:08.638425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638395    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:08.638701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638690    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" containerName="thanos-querier"
Oct 30 11:19:08.638744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638702    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" containerName="thanos-querier"
Oct 30 11:19:08.638744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638735    4488 cpu_manager.go:414] "containerMap: removing container" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo"
Oct 30 11:19:08.638744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638740    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo"
Oct 30 11:19:08.638844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638793    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c060877-40ef-4b2e-8908-44f9f8e0eaaf" containerName="tempo"
Oct 30 11:19:08.638844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.638801    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e9b51ef-b0ef-4e46-8ad3-f7cb5f3287cc" containerName="thanos-querier"
Oct 30 11:19:08.644873 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.644852    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.663021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.662994    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:08.732616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.732563    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.732727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.732628    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.732787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.732742    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmn2\" (UniqueName: \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.833678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.833654    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmn2\" (UniqueName: \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.833802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.833694    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.833890 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.833868    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.834275 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.834256    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.836199 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.836173    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.858108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.858081    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmn2\" (UniqueName: \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\") pod \"data-science-collector-targetallocator-65d75b5fc8-c86d2\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:08.955655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:08.955633    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:09.252251 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.252123    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:09.254794 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:09.254766    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7be1e944_fe74_4fa1_b29c_f78b19b64453.slice/crio-53430c3cf933ab29ab56247741f3a861478a1424db09bfbb615e8209efe4e674 WatchSource:0}: Error finding container 53430c3cf933ab29ab56247741f3a861478a1424db09bfbb615e8209efe4e674: Status 404 returned error can't find the container with id 53430c3cf933ab29ab56247741f3a861478a1424db09bfbb615e8209efe4e674
Oct 30 11:19:09.257127 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.257086    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:09.257215 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.257162    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:09.516606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.516534    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" event={"ID":"7be1e944-fe74-4fa1-b29c-f78b19b64453","Type":"ContainerStarted","Data":"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"}
Oct 30 11:19:09.516606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.516579    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" event={"ID":"7be1e944-fe74-4fa1-b29c-f78b19b64453","Type":"ContainerStarted","Data":"53430c3cf933ab29ab56247741f3a861478a1424db09bfbb615e8209efe4e674"}
Oct 30 11:19:09.517043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.516728    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:09.517637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.517616    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.125:8080/readyz\": dial tcp 10.133.0.125:8080: connect: connection refused"
Oct 30 11:19:09.561106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.561056    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" podStartSLOduration=1.56104409 podStartE2EDuration="1.56104409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:09.560402111 +0000 UTC m=+2045.905993968" watchObservedRunningTime="2026-10-30 11:19:09.56104409 +0000 UTC m=+2045.906635943"
Oct 30 11:19:09.643758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.643736    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:09.743522 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743496    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\") pod \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") "
Oct 30 11:19:09.743669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743534    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\" (UniqueName: \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\") pod \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") "
Oct 30 11:19:09.743669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743582    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\" (UniqueName: \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\") pod \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") "
Oct 30 11:19:09.743669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743633    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\") pod \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") "
Oct 30 11:19:09.743669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743662    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\") pod \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\" (UID: \"d2ad2bd9-55b8-41d4-a79f-060f1422c52d\") "
Oct 30 11:19:09.743983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.743959    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal" pod "d2ad2bd9-55b8-41d4-a79f-060f1422c52d" (UID: "d2ad2bd9-55b8-41d4-a79f-060f1422c52d"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:09.745618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.745587    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs" pod "d2ad2bd9-55b8-41d4-a79f-060f1422c52d" (UID: "d2ad2bd9-55b8-41d4-a79f-060f1422c52d"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:09.745709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.745640    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs" pod "d2ad2bd9-55b8-41d4-a79f-060f1422c52d" (UID: "d2ad2bd9-55b8-41d4-a79f-060f1422c52d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:09.745709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.745676    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert" pod "d2ad2bd9-55b8-41d4-a79f-060f1422c52d" (UID: "d2ad2bd9-55b8-41d4-a79f-060f1422c52d"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:09.745709 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.745678    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh" pod "d2ad2bd9-55b8-41d4-a79f-060f1422c52d" (UID: "d2ad2bd9-55b8-41d4-a79f-060f1422c52d"). InnerVolumeSpecName "kube-api-access-98rlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:09.844888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.844863    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:09.844888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.844890    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:09.845013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.844900    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:09.845013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.844910    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:09.845013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:09.844918    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rlh\" (UniqueName: \"kubernetes.io/projected/d2ad2bd9-55b8-41d4-a79f-060f1422c52d-kube-api-access-98rlh\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:10.521209 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.521173    4488 generic.go:356] "Generic (PLEG): container finished" podID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" containerID="d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4" exitCode=0
Oct 30 11:19:10.521724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.521217    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.521724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.521256    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d2ad2bd9-55b8-41d4-a79f-060f1422c52d","Type":"ContainerDied","Data":"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"}
Oct 30 11:19:10.521724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.521310    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d2ad2bd9-55b8-41d4-a79f-060f1422c52d","Type":"ContainerDied","Data":"9cd40e2b04e174c024ee9c105eea34fb0c158c707fe478cceb907475d3067e04"}
Oct 30 11:19:10.521724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.521362    4488 scope.go:122] "RemoveContainer" containerID="d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"
Oct 30 11:19:10.522802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.522784    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:10.529242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.529223    4488 scope.go:122] "RemoveContainer" containerID="d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"
Oct 30 11:19:10.529545 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:10.529527    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4\": container with ID starting with d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4 not found: ID does not exist" containerID="d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"
Oct 30 11:19:10.529604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.529556    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4"} err="failed to get container status \"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4\": rpc error: code = NotFound desc = could not find container \"d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4\": container with ID starting with d1ddbe1cb029658726d88901fece38c70b8654c3f53ece27b6302acc5aa2ded4 not found: ID does not exist"
Oct 30 11:19:10.622774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.622745    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:19:10.622960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.622939    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" podUID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" containerName="ta-container" containerID="cri-o://b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c" gracePeriod=30
Oct 30 11:19:10.625958 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.625909    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:10.630874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.630852    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:10.670562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.670541    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:10.670849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.670828    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" containerName="otc-container"
Oct 30 11:19:10.670849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.670843    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" containerName="otc-container"
Oct 30 11:19:10.671021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.670921    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" containerName="otc-container"
Oct 30 11:19:10.673704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.673688    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.692552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.692440    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:19:10.692552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.692509    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-xn2fk\""
Oct 30 11:19:10.692733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.692568    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:19:10.692733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.692634    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:19:10.693225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.692946    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:19:10.693717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.693698    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:10.750327 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.750299    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.750435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.750358    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.750475 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.750453    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.750596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.750580    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqjw\" (UniqueName: \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.750673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.750656    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.851967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.851937    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.852106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.851981    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.852106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.852010    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.852106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.852095    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqjw\" (UniqueName: \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.852297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.852136    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.852798 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.852776    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.854803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.854781    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.854889 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.854806    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.854928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.854881    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.871932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.871909    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:19:10.877391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.877370    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqjw\" (UniqueName: \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\") pod \"data-science-collector-collector-1\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:10.952566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.952539    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\" (UniqueName: \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\") pod \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") "
Oct 30 11:19:10.952681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.952598    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\") pod \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") "
Oct 30 11:19:10.952681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.952664    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\") pod \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\" (UID: \"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e\") "
Oct 30 11:19:10.952906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.952885    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal" pod "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" (UID: "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:10.954403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.954374    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8" pod "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" (UID: "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e"). InnerVolumeSpecName "kube-api-access-wlff8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:10.954494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:10.954454    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert" pod "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" (UID: "d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:11.009615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.009596    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:11.054311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.054243    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlff8\" (UniqueName: \"kubernetes.io/projected/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-kube-api-access-wlff8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:11.054451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.054377    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:11.054451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.054400    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:11.099867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.099839    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"]
Oct 30 11:19:11.100139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.100127    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" containerName="ta-container"
Oct 30 11:19:11.100182 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.100140    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" containerName="ta-container"
Oct 30 11:19:11.100236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.100227    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" containerName="ta-container"
Oct 30 11:19:11.104069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.104052    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:11.114433 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.114414    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:11.119410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.119392    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"]
Oct 30 11:19:11.319252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.319229    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:11.321568 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:11.321546    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590675f6_17e1_444d_ada8_76c8a21c097e.slice/crio-8b0ead4fb8e263cde7dcd1d7b9d549dfe5f57e69074ad6a5843c5a45b2416309 WatchSource:0}: Error finding container 8b0ead4fb8e263cde7dcd1d7b9d549dfe5f57e69074ad6a5843c5a45b2416309: Status 404 returned error can't find the container with id 8b0ead4fb8e263cde7dcd1d7b9d549dfe5f57e69074ad6a5843c5a45b2416309
Oct 30 11:19:11.323661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.323630    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:11.323767 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.323695    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:11.409689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.409662    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"]
Oct 30 11:19:11.413139 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:11.413102    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod140f56f1_8e38_4a34_8782_608432d3f0be.slice/crio-cba381ee8375f51f8090c29c30376085885e10a6f012444bfaccf0969648fb9e WatchSource:0}: Error finding container cba381ee8375f51f8090c29c30376085885e10a6f012444bfaccf0969648fb9e: Status 404 returned error can't find the container with id cba381ee8375f51f8090c29c30376085885e10a6f012444bfaccf0969648fb9e
Oct 30 11:19:11.525954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.525921    4488 generic.go:356] "Generic (PLEG): container finished" podID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" containerID="b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c" exitCode=0
Oct 30 11:19:11.526370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.525993    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"
Oct 30 11:19:11.526370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.525995    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" event={"ID":"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e","Type":"ContainerDied","Data":"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"}
Oct 30 11:19:11.526370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.526036    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw" event={"ID":"d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e","Type":"ContainerDied","Data":"0bdabe6624435ab09c6f2e674b8f0914c0dbe0148e29e3e7a665b233d61668d4"}
Oct 30 11:19:11.526370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.526054    4488 scope.go:122] "RemoveContainer" containerID="b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"
Oct 30 11:19:11.527489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.527463    4488 generic.go:356] "Generic (PLEG): container finished" podID="140f56f1-8e38-4a34-8782-608432d3f0be" containerID="49b041b1b3b743f763d2750d598c0ff6d0d8d77edddeae025a85700ae455ed0d" exitCode=0
Oct 30 11:19:11.527601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.527542    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c" event={"ID":"140f56f1-8e38-4a34-8782-608432d3f0be","Type":"ContainerDied","Data":"49b041b1b3b743f763d2750d598c0ff6d0d8d77edddeae025a85700ae455ed0d"}
Oct 30 11:19:11.527601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.527571    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c" event={"ID":"140f56f1-8e38-4a34-8782-608432d3f0be","Type":"ContainerStarted","Data":"cba381ee8375f51f8090c29c30376085885e10a6f012444bfaccf0969648fb9e"}
Oct 30 11:19:11.530278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.530258    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"590675f6-17e1-444d-ada8-76c8a21c097e","Type":"ContainerStarted","Data":"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"}
Oct 30 11:19:11.530403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.530320    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"590675f6-17e1-444d-ada8-76c8a21c097e","Type":"ContainerStarted","Data":"8b0ead4fb8e263cde7dcd1d7b9d549dfe5f57e69074ad6a5843c5a45b2416309"}
Oct 30 11:19:11.547225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.547205    4488 scope.go:122] "RemoveContainer" containerID="b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"
Oct 30 11:19:11.547543 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:11.547524    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c\": container with ID starting with b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c not found: ID does not exist" containerID="b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"
Oct 30 11:19:11.547614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.547551    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c"} err="failed to get container status \"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c\": rpc error: code = NotFound desc = could not find container \"b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c\": container with ID starting with b46dffe766eb2f823a06027a8d4d112552003194193c55ce003e62265797984c not found: ID does not exist"
Oct 30 11:19:11.589118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.589049    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.5890345780000001 podStartE2EDuration="1.589034578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:11.588222883 +0000 UTC m=+2047.933814737" watchObservedRunningTime="2026-10-30 11:19:11.589034578 +0000 UTC m=+2047.934626436"
Oct 30 11:19:11.669074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.669038    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:19:11.671106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.671078    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7db477fc9c-pbpcw"]
Oct 30 11:19:11.802640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.802604    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e" path="/var/lib/kubelet/pods/d08d6b85-d611-4d2c-a9e6-e2bc4d65f80e/volumes"
Oct 30 11:19:11.803046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:11.803027    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2ad2bd9-55b8-41d4-a79f-060f1422c52d" path="/var/lib/kubelet/pods/d2ad2bd9-55b8-41d4-a79f-060f1422c52d/volumes"
Oct 30 11:19:12.669003 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:12.668977    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:13.139877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.139842    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"]
Oct 30 11:19:13.145228 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.145204    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"]
Oct 30 11:19:13.208769 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.208744    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"]
Oct 30 11:19:13.209068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.209052    4488 cpu_manager.go:414] "containerMap: removing container" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" containerName="curl"
Oct 30 11:19:13.209068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.209068    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" containerName="curl"
Oct 30 11:19:13.209185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.209139    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" containerName="curl"
Oct 30 11:19:13.211935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.211920    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"
Oct 30 11:19:13.222275 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.222254    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"
Oct 30 11:19:13.228682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.228661    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"]
Oct 30 11:19:13.519997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.519970    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"]
Oct 30 11:19:13.522724 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:13.522700    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd89c151d_abe7_4bb8_bb72_5105093e76d0.slice/crio-c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd WatchSource:0}: Error finding container c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd: Status 404 returned error can't find the container with id c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd
Oct 30 11:19:13.541128 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.541101    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:13.541236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.541198    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cba381ee8375f51f8090c29c30376085885e10a6f012444bfaccf0969648fb9e"
Oct 30 11:19:13.542476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.542448    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6" event={"ID":"d89c151d-abe7-4bb8-bb72-5105093e76d0","Type":"ContainerStarted","Data":"c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd"}
Oct 30 11:19:13.568177 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:13.567951    4488 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-prometheus-18e34aa570b91d7c\" is forbidden: User \"system:node:ip-10-0-132-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-132-202.ec2.internal' and this object" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:13.802865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:13.802809    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" path="/var/lib/kubelet/pods/140f56f1-8e38-4a34-8782-608432d3f0be/volumes"
Oct 30 11:19:13.814746 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:13.814721    4488 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-prometheus-18e34aa570b91d7c\" is forbidden: User \"system:node:ip-10-0-132-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-132-202.ec2.internal' and this object" podUID="140f56f1-8e38-4a34-8782-608432d3f0be" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e34aa570b91d7c"
Oct 30 11:19:14.547822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:14.547783    4488 generic.go:356] "Generic (PLEG): container finished" podID="d89c151d-abe7-4bb8-bb72-5105093e76d0" containerID="ecf029a695560a566248c0cfa046166ec124b02ad43cad758216d82c1daf69df" exitCode=0
Oct 30 11:19:14.547977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:14.547868    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6" event={"ID":"d89c151d-abe7-4bb8-bb72-5105093e76d0","Type":"ContainerDied","Data":"ecf029a695560a566248c0cfa046166ec124b02ad43cad758216d82c1daf69df"}
Oct 30 11:19:15.681132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:15.681111    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"
Oct 30 11:19:16.557242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:16.557212    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6" event={"ID":"d89c151d-abe7-4bb8-bb72-5105093e76d0","Type":"ContainerDied","Data":"c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd"}
Oct 30 11:19:16.557242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:16.557240    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"
Oct 30 11:19:16.557242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:16.557247    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2fcc873715799c822074c529d67f837c8f6f9381a68e6858c0803849e67dcfd"
Oct 30 11:19:17.262972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.262940    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"]
Oct 30 11:19:17.268774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.268750    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e34aa5ee9b44b6"]
Oct 30 11:19:17.332776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.332754    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"]
Oct 30 11:19:17.333039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.333027    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d89c151d-abe7-4bb8-bb72-5105093e76d0" containerName="curl"
Oct 30 11:19:17.333078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.333040    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d89c151d-abe7-4bb8-bb72-5105093e76d0" containerName="curl"
Oct 30 11:19:17.333125 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.333115    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d89c151d-abe7-4bb8-bb72-5105093e76d0" containerName="curl"
Oct 30 11:19:17.335974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.335958    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"
Oct 30 11:19:17.346377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.346362    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"
Oct 30 11:19:17.351641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.351616    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"]
Oct 30 11:19:17.644131 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.644107    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"]
Oct 30 11:19:17.646868 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:17.646840    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37b3ded2_7b8d_4ca1_8e59_755b30c0c1bc.slice/crio-6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae WatchSource:0}: Error finding container 6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae: Status 404 returned error can't find the container with id 6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae
Oct 30 11:19:17.801650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:17.801624    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d89c151d-abe7-4bb8-bb72-5105093e76d0" path="/var/lib/kubelet/pods/d89c151d-abe7-4bb8-bb72-5105093e76d0/volumes"
Oct 30 11:19:18.567403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:18.567366    4488 generic.go:356] "Generic (PLEG): container finished" podID="37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc" containerID="56e981666f7a223d3915db6e4a3ea69bc7ebf3357e16199f4fcce47da5a4cefa" exitCode=0
Oct 30 11:19:18.567782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:18.567448    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d" event={"ID":"37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc","Type":"ContainerDied","Data":"56e981666f7a223d3915db6e4a3ea69bc7ebf3357e16199f4fcce47da5a4cefa"}
Oct 30 11:19:18.567782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:18.567496    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d" event={"ID":"37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc","Type":"ContainerStarted","Data":"6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae"}
Oct 30 11:19:19.697615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:19.697590    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"
Oct 30 11:19:20.576458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:20.576422    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"
Oct 30 11:19:20.576458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:20.576449    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d" event={"ID":"37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc","Type":"ContainerDied","Data":"6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae"}
Oct 30 11:19:20.576641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:20.576487    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a760947db3d316300c254ea733ab0b965ca5ead2ea5e5531bb2a74692805bae"
Oct 30 11:19:21.409802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.409750    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"]
Oct 30 11:19:21.410708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.410686    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e34aa6e4593b9d"]
Oct 30 11:19:21.473465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.473439    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"]
Oct 30 11:19:21.473747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.473735    4488 cpu_manager.go:414] "containerMap: removing container" podUID="37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc" containerName="curl"
Oct 30 11:19:21.473791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.473748    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc" containerName="curl"
Oct 30 11:19:21.473825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.473816    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc" containerName="curl"
Oct 30 11:19:21.476627 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.476612    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"
Oct 30 11:19:21.486920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.486896    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"
Oct 30 11:19:21.492274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.492239    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"]
Oct 30 11:19:21.782002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.781981    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"]
Oct 30 11:19:21.784459 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:21.784433    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod156c2bbd_80c3_4093_ac40_2e581d0772dc.slice/crio-d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55 WatchSource:0}: Error finding container d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55: Status 404 returned error can't find the container with id d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55
Oct 30 11:19:21.802227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:21.802206    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc" path="/var/lib/kubelet/pods/37b3ded2-7b8d-4ca1-8e59-755b30c0c1bc/volumes"
Oct 30 11:19:22.585740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:22.585706    4488 generic.go:356] "Generic (PLEG): container finished" podID="156c2bbd-80c3-4093-ac40-2e581d0772dc" containerID="dcebb7fb030260696f4d7e2cb7f9d9cd55c683d6472cd52c14f9fad4cacc9399" exitCode=0
Oct 30 11:19:22.586123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:22.585764    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8" event={"ID":"156c2bbd-80c3-4093-ac40-2e581d0772dc","Type":"ContainerDied","Data":"dcebb7fb030260696f4d7e2cb7f9d9cd55c683d6472cd52c14f9fad4cacc9399"}
Oct 30 11:19:22.586123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:22.585792    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8" event={"ID":"156c2bbd-80c3-4093-ac40-2e581d0772dc","Type":"ContainerStarted","Data":"d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55"}
Oct 30 11:19:23.707838 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:23.707813    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"
Oct 30 11:19:24.594438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:24.594401    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"
Oct 30 11:19:24.594438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:24.594432    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8" event={"ID":"156c2bbd-80c3-4093-ac40-2e581d0772dc","Type":"ContainerDied","Data":"d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55"}
Oct 30 11:19:24.594629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:24.594466    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8478073dc12888c56d476efbb6a39bf2a04ab5fa5fb844f114f35089dfc6f55"
Oct 30 11:19:25.527766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.527736    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"]
Oct 30 11:19:25.534862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.534831    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e34aa7db47cdd8"]
Oct 30 11:19:25.619858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.619826    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"]
Oct 30 11:19:25.620151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.620140    4488 cpu_manager.go:414] "containerMap: removing container" podUID="156c2bbd-80c3-4093-ac40-2e581d0772dc" containerName="curl"
Oct 30 11:19:25.620196 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.620154    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="156c2bbd-80c3-4093-ac40-2e581d0772dc" containerName="curl"
Oct 30 11:19:25.620227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.620206    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="156c2bbd-80c3-4093-ac40-2e581d0772dc" containerName="curl"
Oct 30 11:19:25.623057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.623040    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"
Oct 30 11:19:25.640094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.640071    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"]
Oct 30 11:19:25.640826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.640812    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"thanos-ingress-probe-18e34aa8d02fab21\"/\"default-dockercfg-xjpcm\""
Oct 30 11:19:25.643850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.643833    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"
Oct 30 11:19:25.803028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.802965    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="156c2bbd-80c3-4093-ac40-2e581d0772dc" path="/var/lib/kubelet/pods/156c2bbd-80c3-4093-ac40-2e581d0772dc/volumes"
Oct 30 11:19:25.938419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:25.938396    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"]
Oct 30 11:19:25.940829 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:25.940797    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dea554b_6435_4317_a921_6ceab017d269.slice/crio-65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f WatchSource:0}: Error finding container 65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f: Status 404 returned error can't find the container with id 65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f
Oct 30 11:19:26.603505 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:26.603468    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d" event={"ID":"9dea554b-6435-4317-a921-6ceab017d269","Type":"ContainerStarted","Data":"1a46404a71cd75b84e411d693f3145299e3b09c1d6407167b5ec82b95ee83fc3"}
Oct 30 11:19:26.603928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:26.603512    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d" event={"ID":"9dea554b-6435-4317-a921-6ceab017d269","Type":"ContainerStarted","Data":"65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f"}
Oct 30 11:19:26.646453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:26.646404    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d" podStartSLOduration=1.646389662 podStartE2EDuration="1.646389662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:26.645359697 +0000 UTC m=+2062.990951549" watchObservedRunningTime="2026-10-30 11:19:26.646389662 +0000 UTC m=+2062.991981507"
Oct 30 11:19:27.915778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:27.915742    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:27.919238 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:27.919215    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:27.937356 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:27.937326    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:28.076088 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.076060    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.076217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.076113    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.076217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.076165    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvfj\" (UniqueName: \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.177475 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.177450    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.177601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.177499    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.177601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.177525    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvfj\" (UniqueName: \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.178089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.178068    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.179948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.179928    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.202538 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.202512    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvfj\" (UniqueName: \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\") pod \"data-science-collector-targetallocator-7b968c645d-rjs9p\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.230562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.230539    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.532046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.531966    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:28.534965 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:28.534923    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod472bc653_de1a_428b_85fd_4ace980b0e72.slice/crio-194e1d549b549bba3a04d90e99ee171339286b6bc794e06fd8ef4ac2e4056201 WatchSource:0}: Error finding container 194e1d549b549bba3a04d90e99ee171339286b6bc794e06fd8ef4ac2e4056201: Status 404 returned error can't find the container with id 194e1d549b549bba3a04d90e99ee171339286b6bc794e06fd8ef4ac2e4056201
Oct 30 11:19:28.537094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.537053    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:28.537186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.537108    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:28.613357 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.613316    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" event={"ID":"472bc653-de1a-428b-85fd-4ace980b0e72","Type":"ContainerStarted","Data":"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"}
Oct 30 11:19:28.613485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.613374    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" event={"ID":"472bc653-de1a-428b-85fd-4ace980b0e72","Type":"ContainerStarted","Data":"194e1d549b549bba3a04d90e99ee171339286b6bc794e06fd8ef4ac2e4056201"}
Oct 30 11:19:28.613485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.613397    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:28.614781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.614753    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.132:8080/readyz\": dial tcp 10.133.0.132:8080: connect: connection refused"
Oct 30 11:19:28.659937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:28.659891    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" podStartSLOduration=1.659876922 podStartE2EDuration="1.659876922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:28.658711044 +0000 UTC m=+2065.004302899" watchObservedRunningTime="2026-10-30 11:19:28.659876922 +0000 UTC m=+2065.005468773"
Oct 30 11:19:29.618788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:29.618761    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:29.693423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:29.693393    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:29.693589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:29.693565    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerName="ta-container" containerID="cri-o://674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb" gracePeriod=30
Oct 30 11:19:29.938831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:29.938805    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:30.090358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.090316    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\") pod \"7be1e944-fe74-4fa1-b29c-f78b19b64453\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") "
Oct 30 11:19:30.090510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.090397    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\" (UniqueName: \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\") pod \"7be1e944-fe74-4fa1-b29c-f78b19b64453\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") "
Oct 30 11:19:30.090510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.090423    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\" (UniqueName: \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\") pod \"7be1e944-fe74-4fa1-b29c-f78b19b64453\" (UID: \"7be1e944-fe74-4fa1-b29c-f78b19b64453\") "
Oct 30 11:19:30.090809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.090778    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal" pod "7be1e944-fe74-4fa1-b29c-f78b19b64453" (UID: "7be1e944-fe74-4fa1-b29c-f78b19b64453"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:30.092186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.092152    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert" pod "7be1e944-fe74-4fa1-b29c-f78b19b64453" (UID: "7be1e944-fe74-4fa1-b29c-f78b19b64453"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:30.092507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.092485    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2" pod "7be1e944-fe74-4fa1-b29c-f78b19b64453" (UID: "7be1e944-fe74-4fa1-b29c-f78b19b64453"). InnerVolumeSpecName "kube-api-access-jtmn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:30.191702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.191635    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7be1e944-fe74-4fa1-b29c-f78b19b64453-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:30.191702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.191662    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7be1e944-fe74-4fa1-b29c-f78b19b64453-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:30.191702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.191677    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtmn2\" (UniqueName: \"kubernetes.io/projected/7be1e944-fe74-4fa1-b29c-f78b19b64453-kube-api-access-jtmn2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:30.623604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.623525    4488 generic.go:356] "Generic (PLEG): container finished" podID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerID="674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb" exitCode=0
Oct 30 11:19:30.623604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.623581    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"
Oct 30 11:19:30.624066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.623610    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" event={"ID":"7be1e944-fe74-4fa1-b29c-f78b19b64453","Type":"ContainerDied","Data":"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"}
Oct 30 11:19:30.624066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.623651    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2" event={"ID":"7be1e944-fe74-4fa1-b29c-f78b19b64453","Type":"ContainerDied","Data":"53430c3cf933ab29ab56247741f3a861478a1424db09bfbb615e8209efe4e674"}
Oct 30 11:19:30.624066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.623672    4488 scope.go:122] "RemoveContainer" containerID="674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"
Oct 30 11:19:30.632655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.632638    4488 scope.go:122] "RemoveContainer" containerID="674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"
Oct 30 11:19:30.632920 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:30.632901    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb\": container with ID starting with 674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb not found: ID does not exist" containerID="674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"
Oct 30 11:19:30.632971 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.632927    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb"} err="failed to get container status \"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb\": rpc error: code = NotFound desc = could not find container \"674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb\": container with ID starting with 674fef294ddca2f653a141494b06a580ba4764ca95f5fc7859c99e61501eb5fb not found: ID does not exist"
Oct 30 11:19:30.682919 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.682895    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:30.696739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:30.696713    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-c86d2"]
Oct 30 11:19:31.478253 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:31.478217    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:19:31.630848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:31.630815    4488 generic.go:356] "Generic (PLEG): container finished" podID="9dea554b-6435-4317-a921-6ceab017d269" containerID="1a46404a71cd75b84e411d693f3145299e3b09c1d6407167b5ec82b95ee83fc3" exitCode=0
Oct 30 11:19:31.631222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:31.630887    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d" event={"ID":"9dea554b-6435-4317-a921-6ceab017d269","Type":"ContainerDied","Data":"1a46404a71cd75b84e411d693f3145299e3b09c1d6407167b5ec82b95ee83fc3"}
Oct 30 11:19:31.802830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:31.802742    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" path="/var/lib/kubelet/pods/7be1e944-fe74-4fa1-b29c-f78b19b64453/volumes"
Oct 30 11:19:32.752515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:32.752493    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"
Oct 30 11:19:33.641397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.641369    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"
Oct 30 11:19:33.641397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.641386    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d" event={"ID":"9dea554b-6435-4317-a921-6ceab017d269","Type":"ContainerDied","Data":"65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f"}
Oct 30 11:19:33.641645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.641419    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65be78d9d5d639e937f1d57a7b6bbcc3b528a5877995d90eafa01beba64ba21f"
Oct 30 11:19:33.701258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.701232    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"]
Oct 30 11:19:33.707527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.707508    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["thanos-ingress-probe-18e34aa8d02fab21/thanos-ingress-untrusted-18e34aa8d1289d9d"]
Oct 30 11:19:33.801810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:33.801783    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dea554b-6435-4317-a921-6ceab017d269" path="/var/lib/kubelet/pods/9dea554b-6435-4317-a921-6ceab017d269/volumes"
Oct 30 11:19:35.821754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.821723    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:35.822144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822043    4488 cpu_manager.go:414] "containerMap: removing container" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerName="ta-container"
Oct 30 11:19:35.822144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822056    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerName="ta-container"
Oct 30 11:19:35.822144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822067    4488 cpu_manager.go:414] "containerMap: removing container" podUID="9dea554b-6435-4317-a921-6ceab017d269" containerName="curl"
Oct 30 11:19:35.822144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822072    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dea554b-6435-4317-a921-6ceab017d269" containerName="curl"
Oct 30 11:19:35.822144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822138    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="7be1e944-fe74-4fa1-b29c-f78b19b64453" containerName="ta-container"
Oct 30 11:19:35.822324 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.822147    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dea554b-6435-4317-a921-6ceab017d269" containerName="curl"
Oct 30 11:19:35.825096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.825080    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:35.844138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.844116    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:35.934801 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.934774    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:35.934932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.934807    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:35.934932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:35.934844    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt2sv\" (UniqueName: \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.035592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.035562    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.035715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.035606    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.035715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.035662    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt2sv\" (UniqueName: \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.036249 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.036232    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.038067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.038044    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.060641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.060619    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt2sv\" (UniqueName: \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\") pod \"data-science-collector-targetallocator-65d75b5fc8-6968w\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.135905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.135837    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.434960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.434934    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:36.437487 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:36.437457    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb41feabf_c0f8_402e_93b8_7f86faff994d.slice/crio-cbf46231ba096fc0c0f8fe3ae5a6da6222e350fd62e29dd0a67ddf1477adc73c WatchSource:0}: Error finding container cbf46231ba096fc0c0f8fe3ae5a6da6222e350fd62e29dd0a67ddf1477adc73c: Status 404 returned error can't find the container with id cbf46231ba096fc0c0f8fe3ae5a6da6222e350fd62e29dd0a67ddf1477adc73c
Oct 30 11:19:36.439565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.439530    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:36.439660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.439589    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:36.655542 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.655512    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" event={"ID":"b41feabf-c0f8-402e-93b8-7f86faff994d","Type":"ContainerStarted","Data":"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"}
Oct 30 11:19:36.655542 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.655554    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" event={"ID":"b41feabf-c0f8-402e-93b8-7f86faff994d","Type":"ContainerStarted","Data":"cbf46231ba096fc0c0f8fe3ae5a6da6222e350fd62e29dd0a67ddf1477adc73c"}
Oct 30 11:19:36.655768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.655677    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:36.656633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.656607    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.133:8080/readyz\": dial tcp 10.133.0.133:8080: connect: connection refused"
Oct 30 11:19:36.703130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:36.703038    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" podStartSLOduration=1.703025186 podStartE2EDuration="1.703025186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:36.702094017 +0000 UTC m=+2073.047685895" watchObservedRunningTime="2026-10-30 11:19:36.703025186 +0000 UTC m=+2073.048617040"
Oct 30 11:19:37.660982 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:37.660956    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:37.737116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:37.737074    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:37.737316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:37.737281    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" containerName="ta-container" containerID="cri-o://41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc" gracePeriod=30
Oct 30 11:19:37.975011 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:37.974990    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:38.052133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.052102    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\") pod \"472bc653-de1a-428b-85fd-4ace980b0e72\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") "
Oct 30 11:19:38.052274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.052189    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\" (UniqueName: \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\") pod \"472bc653-de1a-428b-85fd-4ace980b0e72\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") "
Oct 30 11:19:38.052274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.052216    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\" (UniqueName: \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\") pod \"472bc653-de1a-428b-85fd-4ace980b0e72\" (UID: \"472bc653-de1a-428b-85fd-4ace980b0e72\") "
Oct 30 11:19:38.052576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.052554    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal" pod "472bc653-de1a-428b-85fd-4ace980b0e72" (UID: "472bc653-de1a-428b-85fd-4ace980b0e72"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:38.054252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.054222    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert" pod "472bc653-de1a-428b-85fd-4ace980b0e72" (UID: "472bc653-de1a-428b-85fd-4ace980b0e72"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:38.054379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.054253    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj" pod "472bc653-de1a-428b-85fd-4ace980b0e72" (UID: "472bc653-de1a-428b-85fd-4ace980b0e72"). InnerVolumeSpecName "kube-api-access-9gvfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:38.152797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.152775    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/472bc653-de1a-428b-85fd-4ace980b0e72-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:38.152797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.152796    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gvfj\" (UniqueName: \"kubernetes.io/projected/472bc653-de1a-428b-85fd-4ace980b0e72-kube-api-access-9gvfj\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:38.152928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.152806    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/472bc653-de1a-428b-85fd-4ace980b0e72-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:38.665127 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.665092    4488 generic.go:356] "Generic (PLEG): container finished" podID="472bc653-de1a-428b-85fd-4ace980b0e72" containerID="41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc" exitCode=0
Oct 30 11:19:38.665553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.665130    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"
Oct 30 11:19:38.665553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.665176    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" event={"ID":"472bc653-de1a-428b-85fd-4ace980b0e72","Type":"ContainerDied","Data":"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"}
Oct 30 11:19:38.665553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.665215    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p" event={"ID":"472bc653-de1a-428b-85fd-4ace980b0e72","Type":"ContainerDied","Data":"194e1d549b549bba3a04d90e99ee171339286b6bc794e06fd8ef4ac2e4056201"}
Oct 30 11:19:38.665553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.665235    4488 scope.go:122] "RemoveContainer" containerID="41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"
Oct 30 11:19:38.673762 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.673744    4488 scope.go:122] "RemoveContainer" containerID="41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"
Oct 30 11:19:38.673995 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:38.673977    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc\": container with ID starting with 41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc not found: ID does not exist" containerID="41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"
Oct 30 11:19:38.674049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.674003    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc"} err="failed to get container status \"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc\": rpc error: code = NotFound desc = could not find container \"41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc\": container with ID starting with 41541914dd8d133f088acc3147161f601c2da7a7b109322117d36b537598babc not found: ID does not exist"
Oct 30 11:19:38.726908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.726881    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:38.740491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:38.740467    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b968c645d-rjs9p"]
Oct 30 11:19:39.802668 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:39.802632    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" path="/var/lib/kubelet/pods/472bc653-de1a-428b-85fd-4ace980b0e72/volumes"
Oct 30 11:19:41.188029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.187993    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:41.188525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.188224    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="590675f6-17e1-444d-ada8-76c8a21c097e" containerName="otc-container" containerID="cri-o://cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934" gracePeriod=30
Oct 30 11:19:41.446713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.446647    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:41.446957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.446945    4488 cpu_manager.go:414] "containerMap: removing container" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" containerName="ta-container"
Oct 30 11:19:41.446996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.446959    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" containerName="ta-container"
Oct 30 11:19:41.447030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.447019    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="472bc653-de1a-428b-85fd-4ace980b0e72" containerName="ta-container"
Oct 30 11:19:41.451116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.451101    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.469159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.469133    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:41.578289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.578260    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.578443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.578305    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9sm\" (UniqueName: \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.578443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.578328    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.678657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.678628    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.678795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.678684    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.678795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.678720    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9sm\" (UniqueName: \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.679239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.679217    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.680999 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.680980    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.703451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.703400    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9sm\" (UniqueName: \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\") pod \"data-science-collector-targetallocator-55ffdb8f7f-v679d\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:41.762490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:41.762468    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:42.060164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.060136    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:42.062965 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:42.062940    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ba623a_b1ee_4b08_8572_22d811db1e7f.slice/crio-c5c2acf95e5f0ae969668863a560d46f72917db8fb165ff1e8036b3d4a567ad4 WatchSource:0}: Error finding container c5c2acf95e5f0ae969668863a560d46f72917db8fb165ff1e8036b3d4a567ad4: Status 404 returned error can't find the container with id c5c2acf95e5f0ae969668863a560d46f72917db8fb165ff1e8036b3d4a567ad4
Oct 30 11:19:42.065525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.065493    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:42.065592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.065555    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:42.166846 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.166815    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:42.170427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.170407    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.187675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.187648    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-serving-cabundle\""
Oct 30 11:19:42.187675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.187669    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:19:42.187833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.187731    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-config\""
Oct 30 11:19:42.187884 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.187857    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-ca-bundle\""
Oct 30 11:19:42.202729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.202705    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:42.220749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.220729    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway-serving-cert\""
Oct 30 11:19:42.220977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.220962    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:19:42.221035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.220963    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-drm5j\""
Oct 30 11:19:42.221035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.220983    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-mtls\""
Oct 30 11:19:42.282671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282648    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282684    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282712    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282859 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282822    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282863    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282888    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.282956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.282942    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.283023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.283002    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383570    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383609    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383650    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383679    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383717    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383747    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.383831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383792    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.384100 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.383846    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.384438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.384391    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.384438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.384391    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.384607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.384519    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.384666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.384627    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.386206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.386175    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.386313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.386293    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.386370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.386300    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.408727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.408709    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:42.686352 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.686306    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" event={"ID":"45ba623a-b1ee-4b08-8572-22d811db1e7f","Type":"ContainerStarted","Data":"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"}
Oct 30 11:19:42.686502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.686382    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:42.686502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.686401    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" event={"ID":"45ba623a-b1ee-4b08-8572-22d811db1e7f","Type":"ContainerStarted","Data":"c5c2acf95e5f0ae969668863a560d46f72917db8fb165ff1e8036b3d4a567ad4"}
Oct 30 11:19:42.688200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.688180    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:42.731203 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.731155    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" podStartSLOduration=1.731142398 podStartE2EDuration="1.731142398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:42.729814008 +0000 UTC m=+2079.075405865" watchObservedRunningTime="2026-10-30 11:19:42.731142398 +0000 UTC m=+2079.076734252"
Oct 30 11:19:42.806454 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.806427    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:42.806623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:42.806604    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerName="ta-container" containerID="cri-o://8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6" gracePeriod=30
Oct 30 11:19:43.044180 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.044158    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:43.188719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.188692    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\" (UniqueName: \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\") pod \"b41feabf-c0f8-402e-93b8-7f86faff994d\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") "
Oct 30 11:19:43.188843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.188725    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\") pod \"b41feabf-c0f8-402e-93b8-7f86faff994d\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") "
Oct 30 11:19:43.188843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.188780    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\") pod \"b41feabf-c0f8-402e-93b8-7f86faff994d\" (UID: \"b41feabf-c0f8-402e-93b8-7f86faff994d\") "
Oct 30 11:19:43.189133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.189113    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal" pod "b41feabf-c0f8-402e-93b8-7f86faff994d" (UID: "b41feabf-c0f8-402e-93b8-7f86faff994d"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:43.190827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.190789    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv" pod "b41feabf-c0f8-402e-93b8-7f86faff994d" (UID: "b41feabf-c0f8-402e-93b8-7f86faff994d"). InnerVolumeSpecName "kube-api-access-bt2sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:43.190827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.190811    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert" pod "b41feabf-c0f8-402e-93b8-7f86faff994d" (UID: "b41feabf-c0f8-402e-93b8-7f86faff994d"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:43.289574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.289524    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt2sv\" (UniqueName: \"kubernetes.io/projected/b41feabf-c0f8-402e-93b8-7f86faff994d-kube-api-access-bt2sv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.289574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.289548    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b41feabf-c0f8-402e-93b8-7f86faff994d-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.289574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.289559    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b41feabf-c0f8-402e-93b8-7f86faff994d-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.511814 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.511788    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:43.592775 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.592707    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\") pod \"590675f6-17e1-444d-ada8-76c8a21c097e\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") "
Oct 30 11:19:43.592921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.592779    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\") pod \"590675f6-17e1-444d-ada8-76c8a21c097e\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") "
Oct 30 11:19:43.592921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.592884    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\") pod \"590675f6-17e1-444d-ada8-76c8a21c097e\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") "
Oct 30 11:19:43.593035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.592942    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\" (UniqueName: \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\") pod \"590675f6-17e1-444d-ada8-76c8a21c097e\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") "
Oct 30 11:19:43.593088 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.593036    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\" (UniqueName: \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\") pod \"590675f6-17e1-444d-ada8-76c8a21c097e\" (UID: \"590675f6-17e1-444d-ada8-76c8a21c097e\") "
Oct 30 11:19:43.593356 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.593311    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal" pod "590675f6-17e1-444d-ada8-76c8a21c097e" (UID: "590675f6-17e1-444d-ada8-76c8a21c097e"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:43.594830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.594803    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert" pod "590675f6-17e1-444d-ada8-76c8a21c097e" (UID: "590675f6-17e1-444d-ada8-76c8a21c097e"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:43.594830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.594820    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs" pod "590675f6-17e1-444d-ada8-76c8a21c097e" (UID: "590675f6-17e1-444d-ada8-76c8a21c097e"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:43.594945 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.594860    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs" pod "590675f6-17e1-444d-ada8-76c8a21c097e" (UID: "590675f6-17e1-444d-ada8-76c8a21c097e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:43.595020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.594994    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw" pod "590675f6-17e1-444d-ada8-76c8a21c097e" (UID: "590675f6-17e1-444d-ada8-76c8a21c097e"). InnerVolumeSpecName "kube-api-access-hmqjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:43.692019 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.691995    4488 generic.go:356] "Generic (PLEG): container finished" podID="590675f6-17e1-444d-ada8-76c8a21c097e" containerID="cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934" exitCode=0
Oct 30 11:19:43.692112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.692045    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:43.692112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.692081    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"590675f6-17e1-444d-ada8-76c8a21c097e","Type":"ContainerDied","Data":"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"}
Oct 30 11:19:43.692191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.692139    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"590675f6-17e1-444d-ada8-76c8a21c097e","Type":"ContainerDied","Data":"8b0ead4fb8e263cde7dcd1d7b9d549dfe5f57e69074ad6a5843c5a45b2416309"}
Oct 30 11:19:43.692191 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.692167    4488 scope.go:122] "RemoveContainer" containerID="cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"
Oct 30 11:19:43.693546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693523    4488 generic.go:356] "Generic (PLEG): container finished" podID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerID="8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6" exitCode=0
Oct 30 11:19:43.693667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693567    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"
Oct 30 11:19:43.693667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693622    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" event={"ID":"b41feabf-c0f8-402e-93b8-7f86faff994d","Type":"ContainerDied","Data":"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"}
Oct 30 11:19:43.693667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693650    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w" event={"ID":"b41feabf-c0f8-402e-93b8-7f86faff994d","Type":"ContainerDied","Data":"cbf46231ba096fc0c0f8fe3ae5a6da6222e350fd62e29dd0a67ddf1477adc73c"}
Oct 30 11:19:43.693833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693718    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmqjw\" (UniqueName: \"kubernetes.io/projected/590675f6-17e1-444d-ada8-76c8a21c097e-kube-api-access-hmqjw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.693898 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693832    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.693898 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693857    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.693898 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693873    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/590675f6-17e1-444d-ada8-76c8a21c097e-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.693898 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.693886    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/590675f6-17e1-444d-ada8-76c8a21c097e-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:43.701629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.701615    4488 scope.go:122] "RemoveContainer" containerID="cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"
Oct 30 11:19:43.702008 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:43.701877    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934\": container with ID starting with cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934 not found: ID does not exist" containerID="cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"
Oct 30 11:19:43.702008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.701900    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934"} err="failed to get container status \"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934\": rpc error: code = NotFound desc = could not find container \"cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934\": container with ID starting with cfaf9cfbac82b752ed7d74d34b6b5b7c64daad8a23e9ceb23be016684f3ad934 not found: ID does not exist"
Oct 30 11:19:43.702008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.701916    4488 scope.go:122] "RemoveContainer" containerID="8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"
Oct 30 11:19:43.709358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.709321    4488 scope.go:122] "RemoveContainer" containerID="8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"
Oct 30 11:19:43.709595 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:43.709577    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6\": container with ID starting with 8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6 not found: ID does not exist" containerID="8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"
Oct 30 11:19:43.709638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.709601    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6"} err="failed to get container status \"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6\": rpc error: code = NotFound desc = could not find container \"8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6\": container with ID starting with 8581cede4413fd0555b5d4410467148f179426579d64e6cf4f7586912fffabf6 not found: ID does not exist"
Oct 30 11:19:43.752744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.752724    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:43.758809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.758790    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:43.795831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.795807    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:43.802685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.802665    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="590675f6-17e1-444d-ada8-76c8a21c097e" path="/var/lib/kubelet/pods/590675f6-17e1-444d-ada8-76c8a21c097e/volumes"
Oct 30 11:19:43.809310 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:43.805612    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65d75b5fc8-6968w"]
Oct 30 11:19:45.801663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:45.801631    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" path="/var/lib/kubelet/pods/b41feabf-c0f8-402e-93b8-7f86faff994d/volumes"
Oct 30 11:19:46.014834 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.014799    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.049685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.049660    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.115754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.115699    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.115837 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.115793    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.134091 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.134070    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.235966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.235935    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fd3ed81014d76a975b5ba6f044c00684e55bfb3daddf6ff0e225ceff74c57792/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.264084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.264061    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.386172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.386107    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:46.714896 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:46.714873    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:46.717225 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:46.717199    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd970f34f_79af_4992_9663_1fef1a59b045.slice/crio-f018595a37558a5d4301bfb8133b333fc1a627995cc29cd13f21fa16c7d1f83a WatchSource:0}: Error finding container f018595a37558a5d4301bfb8133b333fc1a627995cc29cd13f21fa16c7d1f83a: Status 404 returned error can't find the container with id f018595a37558a5d4301bfb8133b333fc1a627995cc29cd13f21fa16c7d1f83a
Oct 30 11:19:47.715600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.715567    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerStarted","Data":"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"}
Oct 30 11:19:47.716081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.715627    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerStarted","Data":"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"}
Oct 30 11:19:47.716081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.715651    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerStarted","Data":"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"}
Oct 30 11:19:47.716081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.715676    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerStarted","Data":"f018595a37558a5d4301bfb8133b333fc1a627995cc29cd13f21fa16c7d1f83a"}
Oct 30 11:19:47.716081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.715709    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:47.718235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.718209    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:47.797493 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:47.797439    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podStartSLOduration=5.797423103 podStartE2EDuration="5.797423103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:47.797296175 +0000 UTC m=+2084.142888027" watchObservedRunningTime="2026-10-30 11:19:47.797423103 +0000 UTC m=+2084.143014957"
Oct 30 11:19:48.719895 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:48.719865    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:48.720276 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:48.719939    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:48.727308 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:48.727284    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:49.709657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.709628    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:19:49.709954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.709943    4488 cpu_manager.go:414] "containerMap: removing container" podUID="590675f6-17e1-444d-ada8-76c8a21c097e" containerName="otc-container"
Oct 30 11:19:49.710009 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.709955    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="590675f6-17e1-444d-ada8-76c8a21c097e" containerName="otc-container"
Oct 30 11:19:49.710009 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.709977    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerName="ta-container"
Oct 30 11:19:49.710009 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.709982    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerName="ta-container"
Oct 30 11:19:49.710105 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.710030    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="590675f6-17e1-444d-ada8-76c8a21c097e" containerName="otc-container"
Oct 30 11:19:49.710105 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.710042    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b41feabf-c0f8-402e-93b8-7f86faff994d" containerName="ta-container"
Oct 30 11:19:49.713163 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.713144    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.747232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.747172    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:19:49.846202 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.846169    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc5dr\" (UniqueName: \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.846399 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.846221    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.846608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.846571    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.947059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.947035    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.947163 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.947069    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc5dr\" (UniqueName: \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.947163 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.947103    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.947773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.947753    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.949447 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.949425    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:49.971833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:49.971807    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc5dr\" (UniqueName: \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\") pod \"data-science-collector-targetallocator-7c4fdbf79b-vw5z8\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:50.024554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.024504    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:50.323219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.323193    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:19:50.325679 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:50.325650    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8438d03_13a9_495e_976f_6f70b875da2b.slice/crio-d787e0ef570b297088dd205f940f5ef3c15fa78dd63d9e5061b75be775ca6da4 WatchSource:0}: Error finding container d787e0ef570b297088dd205f940f5ef3c15fa78dd63d9e5061b75be775ca6da4: Status 404 returned error can't find the container with id d787e0ef570b297088dd205f940f5ef3c15fa78dd63d9e5061b75be775ca6da4
Oct 30 11:19:50.327899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.327860    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:50.327990 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.327934    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:50.439828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.439770    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:50.730132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.730096    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" event={"ID":"c8438d03-13a9-495e-976f-6f70b875da2b","Type":"ContainerStarted","Data":"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"}
Oct 30 11:19:50.730309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.730139    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" event={"ID":"c8438d03-13a9-495e-976f-6f70b875da2b","Type":"ContainerStarted","Data":"d787e0ef570b297088dd205f940f5ef3c15fa78dd63d9e5061b75be775ca6da4"}
Oct 30 11:19:50.730413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.730359    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:50.730473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.730458    4488 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" secret="" err="secret \"tempo-data-science-tempomonolithic-dockercfg-drm5j\" not found"
Oct 30 11:19:50.732068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.732048    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:19:50.774165 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.774121    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" podStartSLOduration=1.77410921 podStartE2EDuration="1.77410921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:50.773385212 +0000 UTC m=+2087.118977068" watchObservedRunningTime="2026-10-30 11:19:50.77410921 +0000 UTC m=+2087.119701466"
Oct 30 11:19:50.846766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.846738    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:50.846950 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:50.846927    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" podUID="45ba623a-b1ee-4b08-8572-22d811db1e7f" containerName="ta-container" containerID="cri-o://59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416" gracePeriod=30
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854149    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854233    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354209884 +0000 UTC m=+2087.699801730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854259    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854313    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354300183 +0000 UTC m=+2087.699892028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854360    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854388    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354380387 +0000 UTC m=+2087.699972255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854425    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854468    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354457592 +0000 UTC m=+2087.700049424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854428    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854500    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354493585 +0000 UTC m=+2087.700085474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854660    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854693    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354684841 +0000 UTC m=+2087.700276690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:50.854756 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854740    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:50.855624 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:50.854778    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:51.354770004 +0000 UTC m=+2087.700361836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:51.081979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.081955    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:51.157014 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.156986    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\") pod \"45ba623a-b1ee-4b08-8572-22d811db1e7f\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") "
Oct 30 11:19:51.157167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.157055    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\") pod \"45ba623a-b1ee-4b08-8572-22d811db1e7f\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") "
Oct 30 11:19:51.157167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.157127    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\" (UniqueName: \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\") pod \"45ba623a-b1ee-4b08-8572-22d811db1e7f\" (UID: \"45ba623a-b1ee-4b08-8572-22d811db1e7f\") "
Oct 30 11:19:51.157406 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.157382    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal" pod "45ba623a-b1ee-4b08-8572-22d811db1e7f" (UID: "45ba623a-b1ee-4b08-8572-22d811db1e7f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:51.157474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.157466    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/45ba623a-b1ee-4b08-8572-22d811db1e7f-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:51.159037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.159014    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm" pod "45ba623a-b1ee-4b08-8572-22d811db1e7f" (UID: "45ba623a-b1ee-4b08-8572-22d811db1e7f"). InnerVolumeSpecName "kube-api-access-9h9sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:51.159124 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.159042    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert" pod "45ba623a-b1ee-4b08-8572-22d811db1e7f" (UID: "45ba623a-b1ee-4b08-8572-22d811db1e7f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:51.258141 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.258116    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/45ba623a-b1ee-4b08-8572-22d811db1e7f-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:51.258141 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.258139    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h9sm\" (UniqueName: \"kubernetes.io/projected/45ba623a-b1ee-4b08-8572-22d811db1e7f-kube-api-access-9h9sm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:51.359461 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359402    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:51.359461 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359416    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359468    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359454925 +0000 UTC m=+2088.705046773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359502    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359520    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359498279 +0000 UTC m=+2088.705090125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359527    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359553    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359539297 +0000 UTC m=+2088.705131143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359572    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359561033 +0000 UTC m=+2088.705152878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359529    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:51.359651 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359648    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359631329 +0000 UTC m=+2088.705223179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:51.359976 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359673    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:51.359976 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359701    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.359694092 +0000 UTC m=+2088.705285924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:51.359976 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359747    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:51.359976 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.359784    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:52.35977258 +0000 UTC m=+2088.705364415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:51.735359 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735305    4488 generic.go:356] "Generic (PLEG): container finished" podID="45ba623a-b1ee-4b08-8572-22d811db1e7f" containerID="59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416" exitCode=0
Oct 30 11:19:51.735535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735371    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"
Oct 30 11:19:51.735535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735392    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" event={"ID":"45ba623a-b1ee-4b08-8572-22d811db1e7f","Type":"ContainerDied","Data":"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"}
Oct 30 11:19:51.735535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735431    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d" event={"ID":"45ba623a-b1ee-4b08-8572-22d811db1e7f","Type":"ContainerDied","Data":"c5c2acf95e5f0ae969668863a560d46f72917db8fb165ff1e8036b3d4a567ad4"}
Oct 30 11:19:51.735535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735447    4488 scope.go:122] "RemoveContainer" containerID="59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"
Oct 30 11:19:51.735769 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735615    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo" containerID="cri-o://34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b" gracePeriod=30
Oct 30 11:19:51.735769 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735692    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway" containerID="cri-o://86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f" gracePeriod=30
Oct 30 11:19:51.735769 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.735675    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway-opa" containerID="cri-o://c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2" gracePeriod=30
Oct 30 11:19:51.746489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.746473    4488 scope.go:122] "RemoveContainer" containerID="59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"
Oct 30 11:19:51.746762 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:51.746741    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416\": container with ID starting with 59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416 not found: ID does not exist" containerID="59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"
Oct 30 11:19:51.746813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.746770    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416"} err="failed to get container status \"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416\": rpc error: code = NotFound desc = could not find container \"59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416\": container with ID starting with 59602eb897f6a1c7c878a807c27be2193b4a2daf3710a9986b251b2c864ad416 not found: ID does not exist"
Oct 30 11:19:51.795742 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.795712    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:51.809727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:51.809702    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55ffdb8f7f-v679d"]
Oct 30 11:19:52.369352 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369323    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369369    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369368    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369411    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369392756 +0000 UTC m=+2090.714984602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369323    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369457    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369445598 +0000 UTC m=+2090.715037435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369474    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369489    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369471139 +0000 UTC m=+2090.715062975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369505    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:52.369512 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369514    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369507143 +0000 UTC m=+2090.715098974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:19:52.369837 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369527    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369521355 +0000 UTC m=+2090.715113187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:19:52.369837 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369549    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369535896 +0000 UTC m=+2090.715127728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:19:52.369837 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369647    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:52.369837 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:52.369682    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert podName:d970f34f-79af-4992-9663-1fef1a59b045 nodeName:}" failed. No retries permitted until 2026-10-30 11:19:54.369675398 +0000 UTC m=+2090.715267231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "d970f34f-79af-4992-9663-1fef1a59b045") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:19:52.716310 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.716273    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.135:8083/ready\": dial tcp 10.133.0.135:8083: connect: connection refused"
Oct 30 11:19:52.747838 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.747806    4488 generic.go:356] "Generic (PLEG): container finished" podID="d970f34f-79af-4992-9663-1fef1a59b045" containerID="c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2" exitCode=0
Oct 30 11:19:52.747838 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.747832    4488 generic.go:356] "Generic (PLEG): container finished" podID="d970f34f-79af-4992-9663-1fef1a59b045" containerID="34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b" exitCode=0
Oct 30 11:19:52.748072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.747888    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerDied","Data":"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"}
Oct 30 11:19:52.748072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.747978    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerDied","Data":"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"}
Oct 30 11:19:52.988923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:52.988897    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:53.076758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076728    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.076917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076778    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.076917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076820    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.076917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076873    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076956    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077081 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.076988    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077099    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077140    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077170    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\") pod \"d970f34f-79af-4992-9663-1fef1a59b045\" (UID: \"d970f34f-79af-4992-9663-1fef1a59b045\") "
Oct 30 11:19:53.077330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077178    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-serving-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:53.077751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077399    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:53.077751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077549    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-serving-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.077751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077731    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:53.077956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.077835    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "gateway-rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:19:53.079607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.079562    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-gateway-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:53.079607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.079565    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "kube-api-access-zqnpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:19:53.079779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.079757    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:53.079930 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.079905    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "gateway-tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:19:53.080275 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.080258    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e" pod "d970f34f-79af-4992-9663-1fef1a59b045" (UID: "d970f34f-79af-4992-9663-1fef1a59b045"). InnerVolumeSpecName "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:19:53.178306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178285    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178306    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-gateway-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178333    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178367    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d970f34f-79af-4992-9663-1fef1a59b045-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178381    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178393    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-gateway-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178409    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/d970f34f-79af-4992-9663-1fef1a59b045-tempo-data-science-tempomonolithic-gateway-serving-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.178623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.178426    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqnpd\" (UniqueName: \"kubernetes.io/projected/d970f34f-79af-4992-9663-1fef1a59b045-kube-api-access-zqnpd\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:19:53.186646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.186631    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:19:53.279302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.279246    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\""
Oct 30 11:19:53.753569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.753539    4488 generic.go:356] "Generic (PLEG): container finished" podID="d970f34f-79af-4992-9663-1fef1a59b045" containerID="86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f" exitCode=0
Oct 30 11:19:53.753719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.753590    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:53.753719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.753619    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerDied","Data":"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"}
Oct 30 11:19:53.753719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.753673    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"d970f34f-79af-4992-9663-1fef1a59b045","Type":"ContainerDied","Data":"f018595a37558a5d4301bfb8133b333fc1a627995cc29cd13f21fa16c7d1f83a"}
Oct 30 11:19:53.753719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.753696    4488 scope.go:122] "RemoveContainer" containerID="c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"
Oct 30 11:19:53.761794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.761775    4488 scope.go:122] "RemoveContainer" containerID="86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"
Oct 30 11:19:53.768870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.768854    4488 scope.go:122] "RemoveContainer" containerID="34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"
Oct 30 11:19:53.775660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.775644    4488 scope.go:122] "RemoveContainer" containerID="c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"
Oct 30 11:19:53.775909 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:53.775889    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2\": container with ID starting with c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2 not found: ID does not exist" containerID="c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"
Oct 30 11:19:53.775977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.775916    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2"} err="failed to get container status \"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2\": rpc error: code = NotFound desc = could not find container \"c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2\": container with ID starting with c6f70f688fd3c57c99d6895a9801a7136958530819379e425e365818a62cdaa2 not found: ID does not exist"
Oct 30 11:19:53.775977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.775933    4488 scope.go:122] "RemoveContainer" containerID="86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"
Oct 30 11:19:53.776193 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:53.776174    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f\": container with ID starting with 86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f not found: ID does not exist" containerID="86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"
Oct 30 11:19:53.776240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.776201    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f"} err="failed to get container status \"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f\": rpc error: code = NotFound desc = could not find container \"86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f\": container with ID starting with 86c1eb3ad2c5c2730f1cf593f8b08b24e861397990c5ae1e7b78cf8b6b2c227f not found: ID does not exist"
Oct 30 11:19:53.776240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.776219    4488 scope.go:122] "RemoveContainer" containerID="34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"
Oct 30 11:19:53.776476 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:19:53.776460    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b\": container with ID starting with 34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b not found: ID does not exist" containerID="34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"
Oct 30 11:19:53.776538 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.776480    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b"} err="failed to get container status \"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b\": rpc error: code = NotFound desc = could not find container \"34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b\": container with ID starting with 34efcf485f9c10f9d830324f0f5daa6e311798c41855915d3fcc0f53aeb8967b not found: ID does not exist"
Oct 30 11:19:53.801931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.801912    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45ba623a-b1ee-4b08-8572-22d811db1e7f" path="/var/lib/kubelet/pods/45ba623a-b1ee-4b08-8572-22d811db1e7f/volumes"
Oct 30 11:19:53.823857 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.823834    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:53.837773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:53.837750    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:55.802405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:55.802375    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d970f34f-79af-4992-9663-1fef1a59b045" path="/var/lib/kubelet/pods/d970f34f-79af-4992-9663-1fef1a59b045/volumes"
Oct 30 11:19:58.565045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565014    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565285    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565296    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565308    4488 cpu_manager.go:414] "containerMap: removing container" podUID="45ba623a-b1ee-4b08-8572-22d811db1e7f" containerName="ta-container"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565313    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45ba623a-b1ee-4b08-8572-22d811db1e7f" containerName="ta-container"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565330    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565335    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565365    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway-opa"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565370    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway-opa"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565415    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565422    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="45ba623a-b1ee-4b08-8572-22d811db1e7f" containerName="ta-container"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565431    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo"
Oct 30 11:19:58.565445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.565438    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d970f34f-79af-4992-9663-1fef1a59b045" containerName="tempo-gateway-opa"
Oct 30 11:19:58.569865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.569845    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.587506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.587481    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:19:58.620037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.620013    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.620137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.620050    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt97s\" (UniqueName: \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.620137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.620076    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.720534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.720507    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.720690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.720548    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt97s\" (UniqueName: \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.720690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.720577    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.721170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.721148    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.722862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.722842    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.746063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.746039    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt97s\" (UniqueName: \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\") pod \"data-science-collector-targetallocator-5bc86fb6fc-zqldt\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.868729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.868663    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:58.872059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.872042    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:58.881243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.881217    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:58.890919 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.890851    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:19:58.903516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.901640    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:58.903729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.903713    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:19:58.903794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.903721    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:19:58.903794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.903763    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-7c92b5b1\""
Oct 30 11:19:58.903881 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.903826    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-xn2fk\""
Oct 30 11:19:58.922362 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.922308    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:58.922480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.922385    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztrw\" (UniqueName: \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:58.922558 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.922474    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:58.922615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.922597    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:58.922653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:58.922629    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.023912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.023873    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.023912 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.023913    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.024135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.023969    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.024135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.024000    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztrw\" (UniqueName: \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.024135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.024026    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.024788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.024759    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.026355 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.026320    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.026450 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.026409    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.026525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.026505    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.048606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.048581    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztrw\" (UniqueName: \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\") pod \"data-science-collector-collector-1\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.183019 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.182982    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:19:59.185313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.185295    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:19:59.185909 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:59.185881    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbd5debc_6602_4366_9678_1ee9a70a0a94.slice/crio-951f053f272c602ba216e8a77499264783eae3c00b2c46a3d1000e2a881511f2 WatchSource:0}: Error finding container 951f053f272c602ba216e8a77499264783eae3c00b2c46a3d1000e2a881511f2: Status 404 returned error can't find the container with id 951f053f272c602ba216e8a77499264783eae3c00b2c46a3d1000e2a881511f2
Oct 30 11:19:59.187995 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.187956    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:59.188085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.188017    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:59.475634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.475553    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:59.479237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.479213    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.496376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.496336    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway-serving-cert\""
Oct 30 11:19:59.496468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.496382    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-serving-cabundle\""
Oct 30 11:19:59.496468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.496434    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-gpwx7\""
Oct 30 11:19:59.499025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.498981    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-ca-bundle\""
Oct 30 11:19:59.499227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.499208    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-config\""
Oct 30 11:19:59.499429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.499216    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-mtls\""
Oct 30 11:19:59.499429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.499266    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:19:59.501193 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.501172    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:19:59.504586 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:19:59.504562    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398f90dd_c06e_431a_9127_f09d821da183.slice/crio-be84cd8cf00d2128b2b19c2f1e427dba5fc33df0a23833487874396dae3d4458 WatchSource:0}: Error finding container be84cd8cf00d2128b2b19c2f1e427dba5fc33df0a23833487874396dae3d4458: Status 404 returned error can't find the container with id be84cd8cf00d2128b2b19c2f1e427dba5fc33df0a23833487874396dae3d4458
Oct 30 11:19:59.505143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.505123    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:19:59.507297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.507269    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:59.507435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.507361    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:19:59.528095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528065    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528126    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528200    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528242    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528275    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528296    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnqtc\" (UniqueName: \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528315    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.528385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.528361    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.596916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.596874    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 11:19:59.629259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629221    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629271    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629293    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629423    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629491    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629525    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnqtc\" (UniqueName: \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629567    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.629643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.629609    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.630234 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.630162    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.630717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.630687    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.631207 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.631183    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.631313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.631277    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.632513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.632465    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.632764 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.632746    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.633014 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.632986    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.655687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.655659    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnqtc\" (UniqueName: \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:19:59.782169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.782090    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"398f90dd-c06e-431a-9127-f09d821da183","Type":"ContainerStarted","Data":"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"}
Oct 30 11:19:59.782169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.782153    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"398f90dd-c06e-431a-9127-f09d821da183","Type":"ContainerStarted","Data":"be84cd8cf00d2128b2b19c2f1e427dba5fc33df0a23833487874396dae3d4458"}
Oct 30 11:19:59.783884 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.783856    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" event={"ID":"bbd5debc-6602-4366-9678-1ee9a70a0a94","Type":"ContainerStarted","Data":"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"}
Oct 30 11:19:59.784022 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.783894    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" event={"ID":"bbd5debc-6602-4366-9678-1ee9a70a0a94","Type":"ContainerStarted","Data":"951f053f272c602ba216e8a77499264783eae3c00b2c46a3d1000e2a881511f2"}
Oct 30 11:19:59.784080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.784017    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:59.785452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.785432    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:19:59.827711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.827671    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.827660378 podStartE2EDuration="1.827660378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:59.82732875 +0000 UTC m=+2096.172920605" watchObservedRunningTime="2026-10-30 11:19:59.827660378 +0000 UTC m=+2096.173252229"
Oct 30 11:19:59.875562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.875509    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" podStartSLOduration=1.875492823 podStartE2EDuration="1.875492823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:19:59.87468136 +0000 UTC m=+2096.220273216" watchObservedRunningTime="2026-10-30 11:19:59.875492823 +0000 UTC m=+2096.221084674"
Oct 30 11:19:59.903714 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.903679    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:19:59.903913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:19:59.903879    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" podUID="c8438d03-13a9-495e-976f-6f70b875da2b" containerName="ta-container" containerID="cri-o://e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295" gracePeriod=30
Oct 30 11:20:00.143826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.143802    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:20:00.235771 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.235744    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\") pod \"c8438d03-13a9-495e-976f-6f70b875da2b\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") "
Oct 30 11:20:00.235927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.235832    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\" (UniqueName: \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\") pod \"c8438d03-13a9-495e-976f-6f70b875da2b\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") "
Oct 30 11:20:00.235927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.235872    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\") pod \"c8438d03-13a9-495e-976f-6f70b875da2b\" (UID: \"c8438d03-13a9-495e-976f-6f70b875da2b\") "
Oct 30 11:20:00.236250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.236229    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal" pod "c8438d03-13a9-495e-976f-6f70b875da2b" (UID: "c8438d03-13a9-495e-976f-6f70b875da2b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:00.237816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.237786    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert" pod "c8438d03-13a9-495e-976f-6f70b875da2b" (UID: "c8438d03-13a9-495e-976f-6f70b875da2b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:00.237918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.237814    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr" pod "c8438d03-13a9-495e-976f-6f70b875da2b" (UID: "c8438d03-13a9-495e-976f-6f70b875da2b"). InnerVolumeSpecName "kube-api-access-kc5dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:00.336587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.336511    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc5dr\" (UniqueName: \"kubernetes.io/projected/c8438d03-13a9-495e-976f-6f70b875da2b-kube-api-access-kc5dr\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:00.336587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.336545    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c8438d03-13a9-495e-976f-6f70b875da2b-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:00.336587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.336556    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c8438d03-13a9-495e-976f-6f70b875da2b-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:00.789985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.789950    4488 generic.go:356] "Generic (PLEG): container finished" podID="c8438d03-13a9-495e-976f-6f70b875da2b" containerID="e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295" exitCode=0
Oct 30 11:20:00.790488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.789995    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"
Oct 30 11:20:00.790488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.790029    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" event={"ID":"c8438d03-13a9-495e-976f-6f70b875da2b","Type":"ContainerDied","Data":"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"}
Oct 30 11:20:00.790488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.790071    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8" event={"ID":"c8438d03-13a9-495e-976f-6f70b875da2b","Type":"ContainerDied","Data":"d787e0ef570b297088dd205f940f5ef3c15fa78dd63d9e5061b75be775ca6da4"}
Oct 30 11:20:00.790488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.790088    4488 scope.go:122] "RemoveContainer" containerID="e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"
Oct 30 11:20:00.799530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.799505    4488 scope.go:122] "RemoveContainer" containerID="e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"
Oct 30 11:20:00.800258 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:00.800230    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295\": container with ID starting with e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295 not found: ID does not exist" containerID="e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"
Oct 30 11:20:00.800394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.800266    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295"} err="failed to get container status \"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295\": rpc error: code = NotFound desc = could not find container \"e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295\": container with ID starting with e053f49c4b3d6d44b9e5bae62fa2b642cffdabce8a151365b399739e42768295 not found: ID does not exist"
Oct 30 11:20:00.844625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.844598    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:20:00.848594 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:00.848573    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c4fdbf79b-vw5z8"]
Oct 30 11:20:01.477853 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:01.477819    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:20:01.802127 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:01.802059    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8438d03-13a9-495e-976f-6f70b875da2b" path="/var/lib/kubelet/pods/c8438d03-13a9-495e-976f-6f70b875da2b/volumes"
Oct 30 11:20:04.975268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:04.975238    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.008236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.008205    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.075796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.075767    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.075923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.075862    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.101935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.101911    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.203892 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.203857    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fd3ed81014d76a975b5ba6f044c00684e55bfb3daddf6ff0e225ceff74c57792/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.234887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.234836    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.512107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.512041    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-gpwx7\""
Oct 30 11:20:05.517132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.517112    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:05.848246 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:05.848208    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff29b593_a708_4a4b_80b4_7dc69fe6d358.slice/crio-f29b5e5dafe24612bd6b02fe12833d007bf766199572a8feefa9f21c81fad375 WatchSource:0}: Error finding container f29b5e5dafe24612bd6b02fe12833d007bf766199572a8feefa9f21c81fad375: Status 404 returned error can't find the container with id f29b5e5dafe24612bd6b02fe12833d007bf766199572a8feefa9f21c81fad375
Oct 30 11:20:05.859630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:05.859608    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:20:06.571230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.571193    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:06.571645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.571459    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="398f90dd-c06e-431a-9127-f09d821da183" containerName="otc-container" containerID="cri-o://e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891" gracePeriod=30
Oct 30 11:20:06.777304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.777272    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:06.777643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.777627    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c8438d03-13a9-495e-976f-6f70b875da2b" containerName="ta-container"
Oct 30 11:20:06.777694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.777645    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8438d03-13a9-495e-976f-6f70b875da2b" containerName="ta-container"
Oct 30 11:20:06.777694 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.777690    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8438d03-13a9-495e-976f-6f70b875da2b" containerName="ta-container"
Oct 30 11:20:06.780637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.780622    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:06.801741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.801712    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:06.818825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818793    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerStarted","Data":"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"}
Oct 30 11:20:06.818943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818850    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerStarted","Data":"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"}
Oct 30 11:20:06.818943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818875    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerStarted","Data":"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"}
Oct 30 11:20:06.818943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818894    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerStarted","Data":"f29b5e5dafe24612bd6b02fe12833d007bf766199572a8feefa9f21c81fad375"}
Oct 30 11:20:06.818943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818920    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:06.818943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818942    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:06.819132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.818957    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:06.821501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.821446    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:06.827542 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.827524    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:06.872945 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.872908    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podStartSLOduration=7.872897677 podStartE2EDuration="7.872897677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:06.871632553 +0000 UTC m=+2103.217224430" watchObservedRunningTime="2026-10-30 11:20:06.872897677 +0000 UTC m=+2103.218489531"
Oct 30 11:20:06.991606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.991579    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whnxn\" (UniqueName: \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:06.991746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.991617    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:06.991746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:06.991646    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.092743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.092662    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whnxn\" (UniqueName: \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.092743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.092714    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.092743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.092743    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.093323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.093301    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.095039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.095021    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.117613 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.117591    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whnxn\" (UniqueName: \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\") pod \"data-science-collector-targetallocator-685d5d858b-8gp89\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.392359 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.392271    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:07.508375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.508325    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:20:07.691466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.691439    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:07.722282 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:07.722248    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f2549d6_9c25_436c_bd0a_7bd97711ca5d.slice/crio-d8c6871992893a4065ea275ac5b3b425f849c45142341db936a23bb0dd65bafd WatchSource:0}: Error finding container d8c6871992893a4065ea275ac5b3b425f849c45142341db936a23bb0dd65bafd: Status 404 returned error can't find the container with id d8c6871992893a4065ea275ac5b3b425f849c45142341db936a23bb0dd65bafd
Oct 30 11:20:07.724620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.724583    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:07.724738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.724649    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:07.803107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.803085    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:07.824054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.824026    4488 generic.go:356] "Generic (PLEG): container finished" podID="398f90dd-c06e-431a-9127-f09d821da183" containerID="e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891" exitCode=0
Oct 30 11:20:07.824230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.824066    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:07.824230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.824112    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"398f90dd-c06e-431a-9127-f09d821da183","Type":"ContainerDied","Data":"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"}
Oct 30 11:20:07.824230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.824205    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"398f90dd-c06e-431a-9127-f09d821da183","Type":"ContainerDied","Data":"be84cd8cf00d2128b2b19c2f1e427dba5fc33df0a23833487874396dae3d4458"}
Oct 30 11:20:07.824388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.824246    4488 scope.go:122] "RemoveContainer" containerID="e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"
Oct 30 11:20:07.825762 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.825740    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" event={"ID":"4f2549d6-9c25-436c-bd0a-7bd97711ca5d","Type":"ContainerStarted","Data":"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"}
Oct 30 11:20:07.825875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.825780    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" event={"ID":"4f2549d6-9c25-436c-bd0a-7bd97711ca5d","Type":"ContainerStarted","Data":"d8c6871992893a4065ea275ac5b3b425f849c45142341db936a23bb0dd65bafd"}
Oct 30 11:20:07.826097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.826075    4488 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" secret="" err="secret \"tempo-data-science-tempomonolithic-dockercfg-gpwx7\" not found"
Oct 30 11:20:07.832557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.832542    4488 scope.go:122] "RemoveContainer" containerID="e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"
Oct 30 11:20:07.832804 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.832786    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891\": container with ID starting with e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891 not found: ID does not exist" containerID="e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"
Oct 30 11:20:07.832865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.832814    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891"} err="failed to get container status \"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891\": rpc error: code = NotFound desc = could not find container \"e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891\": container with ID starting with e9daa134b2aaf46de1ee8740caeb5cf7af03e76d7156d811163e672fdc094891 not found: ID does not exist"
Oct 30 11:20:07.898045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898021    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\" (UniqueName: \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\") pod \"398f90dd-c06e-431a-9127-f09d821da183\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") "
Oct 30 11:20:07.898166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898055    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\") pod \"398f90dd-c06e-431a-9127-f09d821da183\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") "
Oct 30 11:20:07.898166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898094    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\" (UniqueName: \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\") pod \"398f90dd-c06e-431a-9127-f09d821da183\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") "
Oct 30 11:20:07.898166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898116    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\") pod \"398f90dd-c06e-431a-9127-f09d821da183\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") "
Oct 30 11:20:07.898166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898155    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\") pod \"398f90dd-c06e-431a-9127-f09d821da183\" (UID: \"398f90dd-c06e-431a-9127-f09d821da183\") "
Oct 30 11:20:07.898436 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.898375    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal" pod "398f90dd-c06e-431a-9127-f09d821da183" (UID: "398f90dd-c06e-431a-9127-f09d821da183"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:07.900157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.900129    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw" pod "398f90dd-c06e-431a-9127-f09d821da183" (UID: "398f90dd-c06e-431a-9127-f09d821da183"). InnerVolumeSpecName "kube-api-access-dztrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:07.900284 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.900161    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs" pod "398f90dd-c06e-431a-9127-f09d821da183" (UID: "398f90dd-c06e-431a-9127-f09d821da183"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:07.900284 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.900212    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs" pod "398f90dd-c06e-431a-9127-f09d821da183" (UID: "398f90dd-c06e-431a-9127-f09d821da183"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:07.900284 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.900232    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert" pod "398f90dd-c06e-431a-9127-f09d821da183" (UID: "398f90dd-c06e-431a-9127-f09d821da183"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:07.908925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:07.908860    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" podStartSLOduration=1.908848946 podStartE2EDuration="1.908848946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:07.908013253 +0000 UTC m=+2104.253605108" watchObservedRunningTime="2026-10-30 11:20:07.908848946 +0000 UTC m=+2104.254440800"
Oct 30 11:20:07.999750 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999720    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:07.999878 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999763    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:07.999878 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999794    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.499772229 +0000 UTC m=+2104.845364091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:07.999878 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999821    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.499804325 +0000 UTC m=+2104.845396179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:07.999878 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999763    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999903    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.499885147 +0000 UTC m=+2104.845477005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999735    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999931    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999948    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:07.999978    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.499956082 +0000 UTC m=+2104.845547915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.000001    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/398f90dd-c06e-431a-9127-f09d821da183-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.000014    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.500008418 +0000 UTC m=+2104.845600271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.000030    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.000049    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.000064    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.500057964 +0000 UTC m=+2104.845649799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.000054    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dztrw\" (UniqueName: \"kubernetes.io/projected/398f90dd-c06e-431a-9127-f09d821da183-kube-api-access-dztrw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.000088    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:08.500075471 +0000 UTC m=+2104.845667360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.000107    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:08.000120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.000124    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/398f90dd-c06e-431a-9127-f09d821da183-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:08.172392 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.172363    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:08.176614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.176593    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:08.504628 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504560    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:08.504628 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504595    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:08.504628 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504561    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504634    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.504614038 +0000 UTC m=+2105.850205886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504653    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.50464357 +0000 UTC m=+2105.850235404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504669    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.50466188 +0000 UTC m=+2105.850253711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504570    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504734    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.50471902 +0000 UTC m=+2105.850310852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504573    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504618    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504767    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.504758525 +0000 UTC m=+2105.850350358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504788    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.504777727 +0000 UTC m=+2105.850369558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504627    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:08.504869 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:08.504815    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:09.504807795 +0000 UTC m=+2105.850399628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:08.832952 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.832860    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo" containerID="cri-o://a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea" gracePeriod=30
Oct 30 11:20:08.832952 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.832913    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway" containerID="cri-o://8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a" gracePeriod=30
Oct 30 11:20:08.833495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.832913    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway-opa" containerID="cri-o://22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2" gracePeriod=30
Oct 30 11:20:08.833495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.833050    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:08.835080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.835057    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:08.961064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.961014    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:20:08.961214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:08.961188    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" podUID="bbd5debc-6602-4366-9678-1ee9a70a0a94" containerName="ta-container" containerID="cri-o://42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f" gracePeriod=30
Oct 30 11:20:09.196484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.196458    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:20:09.312281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.312254    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\") pod \"bbd5debc-6602-4366-9678-1ee9a70a0a94\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") "
Oct 30 11:20:09.312281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.312283    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\" (UniqueName: \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\") pod \"bbd5debc-6602-4366-9678-1ee9a70a0a94\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") "
Oct 30 11:20:09.312474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.312304    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\" (UniqueName: \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\") pod \"bbd5debc-6602-4366-9678-1ee9a70a0a94\" (UID: \"bbd5debc-6602-4366-9678-1ee9a70a0a94\") "
Oct 30 11:20:09.312667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.312646    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal" pod "bbd5debc-6602-4366-9678-1ee9a70a0a94" (UID: "bbd5debc-6602-4366-9678-1ee9a70a0a94"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:09.312738 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.312723    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bbd5debc-6602-4366-9678-1ee9a70a0a94-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:09.314267 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.314246    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s" pod "bbd5debc-6602-4366-9678-1ee9a70a0a94" (UID: "bbd5debc-6602-4366-9678-1ee9a70a0a94"). InnerVolumeSpecName "kube-api-access-vt97s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:09.314387 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.314330    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert" pod "bbd5debc-6602-4366-9678-1ee9a70a0a94" (UID: "bbd5debc-6602-4366-9678-1ee9a70a0a94"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:09.413848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.413827    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bbd5debc-6602-4366-9678-1ee9a70a0a94-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:09.413914 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.413849    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt97s\" (UniqueName: \"kubernetes.io/projected/bbd5debc-6602-4366-9678-1ee9a70a0a94-kube-api-access-vt97s\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:09.514798 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514772    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway-serving-cert: secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514803    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-mtls: secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514816    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-serving-cabundle: configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514839    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514821447 +0000 UTC m=+2107.860413279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-gateway-serving-cert" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway-serving-cert" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514779    4488 secret.go:189] Couldn't get secret redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514856    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-gateway: configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514859    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-config: configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514866    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.51485108 +0000 UTC m=+2107.860442931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-serving-cabundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-serving-cabundle" not found
Oct 30 11:20:09.514899 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514897    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/tempo-data-science-tempomonolithic-ca-bundle: configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:09.515168 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514909    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514900443 +0000 UTC m=+2107.860492278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-mtls" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-mtls" not found
Oct 30 11:20:09.515168 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514922    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514916438 +0000 UTC m=+2107.860508269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "gateway-tenants" (UniqueName: "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : secret "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:09.515168 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514934    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514927964 +0000 UTC m=+2107.860519797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "gateway-rbac" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-gateway" not found
Oct 30 11:20:09.515168 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514951    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514942875 +0000 UTC m=+2107.860534710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-conf" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-config" not found
Oct 30 11:20:09.515168 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.514968    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle podName:ff29b593-a708-4a4b-80b4-7dc69fe6d358 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:11.514962852 +0000 UTC m=+2107.860554684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tempo-data-science-tempomonolithic-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle") pod "tempo-data-science-tempomonolithic-0" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358") : configmap "tempo-data-science-tempomonolithic-ca-bundle" not found
Oct 30 11:20:09.808025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.807994    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="398f90dd-c06e-431a-9127-f09d821da183" path="/var/lib/kubelet/pods/398f90dd-c06e-431a-9127-f09d821da183/volumes"
Oct 30 11:20:09.839010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.838986    4488 generic.go:356] "Generic (PLEG): container finished" podID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerID="22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2" exitCode=0
Oct 30 11:20:09.839010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.839011    4488 generic.go:356] "Generic (PLEG): container finished" podID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerID="a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea" exitCode=0
Oct 30 11:20:09.839418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.839055    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerDied","Data":"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"}
Oct 30 11:20:09.839418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.839095    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerDied","Data":"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"}
Oct 30 11:20:09.840269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.840251    4488 generic.go:356] "Generic (PLEG): container finished" podID="bbd5debc-6602-4366-9678-1ee9a70a0a94" containerID="42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f" exitCode=0
Oct 30 11:20:09.840334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.840297    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"
Oct 30 11:20:09.840334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.840320    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" event={"ID":"bbd5debc-6602-4366-9678-1ee9a70a0a94","Type":"ContainerDied","Data":"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"}
Oct 30 11:20:09.840429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.840357    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt" event={"ID":"bbd5debc-6602-4366-9678-1ee9a70a0a94","Type":"ContainerDied","Data":"951f053f272c602ba216e8a77499264783eae3c00b2c46a3d1000e2a881511f2"}
Oct 30 11:20:09.840429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.840374    4488 scope.go:122] "RemoveContainer" containerID="42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"
Oct 30 11:20:09.848302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.848284    4488 scope.go:122] "RemoveContainer" containerID="42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"
Oct 30 11:20:09.848588 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:09.848571    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f\": container with ID starting with 42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f not found: ID does not exist" containerID="42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"
Oct 30 11:20:09.848646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.848595    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f"} err="failed to get container status \"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f\": rpc error: code = NotFound desc = could not find container \"42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f\": container with ID starting with 42f5d3b3c52a42f8a7d793b5ed7fc6cd8fc16d9bedaa088d74a6b023b4adf96f not found: ID does not exist"
Oct 30 11:20:09.902292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.902268    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:20:09.913907 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:09.913887    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bc86fb6fc-zqldt"]
Oct 30 11:20:10.071789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.071740    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:10.220844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.220811    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.220981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.220855    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.220981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.220906    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.220981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.220933    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.220981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.220958    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.221201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221070    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221108    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\" (UniqueName: \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221302    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "gateway-rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221316    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221384    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\") pod \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\" (UID: \"ff29b593-a708-4a4b-80b4-7dc69fe6d358\") "
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221392    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:10.221571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221554    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-serving-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:10.222035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221778    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-serving-cabundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.222035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221783    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:10.222035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221800    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.222035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.221813    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-conf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.224624 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.224595    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "kube-api-access-lnqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:10.225017 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.224990    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-gateway-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:10.225134 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.225029    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:10.225134 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.225056    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "gateway-tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:10.226185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.226163    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e" pod "ff29b593-a708-4a4b-80b4-7dc69fe6d358" (UID: "ff29b593-a708-4a4b-80b4-7dc69fe6d358"). InnerVolumeSpecName "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:20:10.322451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322397    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.322451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322420    4488 reconciler_common.go:299] "Volume detached for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-gateway-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.322451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322430    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-gateway-serving-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.322451 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322439    4488 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/ff29b593-a708-4a4b-80b4-7dc69fe6d358-tempo-data-science-tempomonolithic-mtls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.322653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322468    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:20:10.322653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.322483    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnqtc\" (UniqueName: \"kubernetes.io/projected/ff29b593-a708-4a4b-80b4-7dc69fe6d358-kube-api-access-lnqtc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:10.333917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.333894    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:20:10.423835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.423813    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-9ed1a45c-662a-4ce3-b563-4ea35a995f32\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0851a5e725334572e\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-06bb76545188d6302e658b5d7c1748c9c0088a17a8d9609283bd464890aa804d\""
Oct 30 11:20:10.843317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843284    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:10.843727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843707    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo"
Oct 30 11:20:10.843727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843723    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843746    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bbd5debc-6602-4366-9678-1ee9a70a0a94" containerName="ta-container"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843751    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbd5debc-6602-4366-9678-1ee9a70a0a94" containerName="ta-container"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843762    4488 cpu_manager.go:414] "containerMap: removing container" podUID="398f90dd-c06e-431a-9127-f09d821da183" containerName="otc-container"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843769    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="398f90dd-c06e-431a-9127-f09d821da183" containerName="otc-container"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843778    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843784    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843791    4488 cpu_manager.go:414] "containerMap: removing container" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway-opa"
Oct 30 11:20:10.843815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843795    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway-opa"
Oct 30 11:20:10.844072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843843    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbd5debc-6602-4366-9678-1ee9a70a0a94" containerName="ta-container"
Oct 30 11:20:10.844072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843851    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="398f90dd-c06e-431a-9127-f09d821da183" containerName="otc-container"
Oct 30 11:20:10.844072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843857    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway"
Oct 30 11:20:10.844072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843862    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo-gateway-opa"
Oct 30 11:20:10.844072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.843870    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerName="tempo"
Oct 30 11:20:10.846503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.846481    4488 generic.go:356] "Generic (PLEG): container finished" podID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" containerID="8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a" exitCode=0
Oct 30 11:20:10.846633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.846611    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 11:20:10.847808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.847787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerDied","Data":"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"}
Oct 30 11:20:10.847906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.847823    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"ff29b593-a708-4a4b-80b4-7dc69fe6d358","Type":"ContainerDied","Data":"f29b5e5dafe24612bd6b02fe12833d007bf766199572a8feefa9f21c81fad375"}
Oct 30 11:20:10.847906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.847896    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.847981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.847908    4488 scope.go:122] "RemoveContainer" containerID="22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"
Oct 30 11:20:10.857246 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.857157    4488 scope.go:122] "RemoveContainer" containerID="8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"
Oct 30 11:20:10.865089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.865071    4488 scope.go:122] "RemoveContainer" containerID="a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"
Oct 30 11:20:10.874274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.874247    4488 scope.go:122] "RemoveContainer" containerID="22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"
Oct 30 11:20:10.874617 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:10.874598    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2\": container with ID starting with 22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2 not found: ID does not exist" containerID="22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"
Oct 30 11:20:10.874675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.874625    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2"} err="failed to get container status \"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2\": rpc error: code = NotFound desc = could not find container \"22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2\": container with ID starting with 22ba6cb770df1fcbfdeac1fc868487c1bd700dfb93a300d7ed38b92d5c6250c2 not found: ID does not exist"
Oct 30 11:20:10.874675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.874643    4488 scope.go:122] "RemoveContainer" containerID="8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"
Oct 30 11:20:10.874902 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:10.874880    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a\": container with ID starting with 8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a not found: ID does not exist" containerID="8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"
Oct 30 11:20:10.874947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.874914    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a"} err="failed to get container status \"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a\": rpc error: code = NotFound desc = could not find container \"8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a\": container with ID starting with 8c206b0506b9d06af9eb9694374d9299f3d7e9987b0968cbf45992c79660fe4a not found: ID does not exist"
Oct 30 11:20:10.874947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.874937    4488 scope.go:122] "RemoveContainer" containerID="a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"
Oct 30 11:20:10.875211 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:10.875190    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea\": container with ID starting with a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea not found: ID does not exist" containerID="a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"
Oct 30 11:20:10.875262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.875220    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea"} err="failed to get container status \"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea\": rpc error: code = NotFound desc = could not find container \"a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea\": container with ID starting with a6110e7f2c68dcd3611021d570b715ea3dc340f1df5ea2a78c946a833c96d0ea not found: ID does not exist"
Oct 30 11:20:10.880262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.880244    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:20:10.880453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.880436    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-xn2fk\""
Oct 30 11:20:10.880521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.880468    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:20:10.894626 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.894608    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:20:10.895661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.895643    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:10.928572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.928545    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.928678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.928596    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jz5p\" (UniqueName: \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.928762 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.928745    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.928832 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.928816    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.928999 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.928984    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:10.966482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.966463    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:20:10.966813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.966798    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:20:10.970182 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:10.970162    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 11:20:11.029496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.029470    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.029576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.029501    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.029576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.029524    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.029673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.029575    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.029673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.029607    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jz5p\" (UniqueName: \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.030159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.030133    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.032031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.032012    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.032109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.032057    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.032157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.032120    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.061331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.061303    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jz5p\" (UniqueName: \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\") pod \"data-science-collector-collector-0\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.165259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.165202    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:11.453591 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.453552    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"]
Oct 30 11:20:11.457776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.457743    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.470647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.470619    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"]
Oct 30 11:20:11.474216 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:11.472951    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2t9nf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk" podUID="b3cf9d4e-e192-4f08-b0cd-4a417f083f50"
Oct 30 11:20:11.475402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.475376    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:11.480081 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:11.480058    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fafa17_8d7b_4bbf_bef5_4e09a85c05f5.slice/crio-ee45a66c0f3e4c1a8ff41ac8906d7bb71dc631acd2a59ed779a5d242960b5b06 WatchSource:0}: Error finding container ee45a66c0f3e4c1a8ff41ac8906d7bb71dc631acd2a59ed779a5d242960b5b06: Status 404 returned error can't find the container with id ee45a66c0f3e4c1a8ff41ac8906d7bb71dc631acd2a59ed779a5d242960b5b06
Oct 30 11:20:11.482935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.482903    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:11.483035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.482971    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:11.533398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.533370    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9nf\" (UniqueName: \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk\" (UID: \"b3cf9d4e-e192-4f08-b0cd-4a417f083f50\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.544382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.544352    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"]
Oct 30 11:20:11.634668 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.634626    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9nf\" (UniqueName: \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk\" (UID: \"b3cf9d4e-e192-4f08-b0cd-4a417f083f50\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.660311 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.660280    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9nf\" (UniqueName: \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk\" (UID: \"b3cf9d4e-e192-4f08-b0cd-4a417f083f50\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.803693 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.803622    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbd5debc-6602-4366-9678-1ee9a70a0a94" path="/var/lib/kubelet/pods/bbd5debc-6602-4366-9678-1ee9a70a0a94/volumes"
Oct 30 11:20:11.804042 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.804029    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff29b593-a708-4a4b-80b4-7dc69fe6d358" path="/var/lib/kubelet/pods/ff29b593-a708-4a4b-80b4-7dc69fe6d358/volumes"
Oct 30 11:20:11.853987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.853954    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.854455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.853987    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5","Type":"ContainerStarted","Data":"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"}
Oct 30 11:20:11.854455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.854037    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5","Type":"ContainerStarted","Data":"ee45a66c0f3e4c1a8ff41ac8906d7bb71dc631acd2a59ed779a5d242960b5b06"}
Oct 30 11:20:11.861984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.861964    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:11.908689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.908621    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.90860626 podStartE2EDuration="1.90860626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:11.907115286 +0000 UTC m=+2108.252707138" watchObservedRunningTime="2026-10-30 11:20:11.90860626 +0000 UTC m=+2108.254198113"
Oct 30 11:20:11.936114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.936075    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\" (UniqueName: \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\") pod \"b3cf9d4e-e192-4f08-b0cd-4a417f083f50\" (UID: \"b3cf9d4e-e192-4f08-b0cd-4a417f083f50\") "
Oct 30 11:20:11.938240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:11.938209    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf" pod "b3cf9d4e-e192-4f08-b0cd-4a417f083f50" (UID: "b3cf9d4e-e192-4f08-b0cd-4a417f083f50"). InnerVolumeSpecName "kube-api-access-2t9nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:12.037622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.037592    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t9nf\" (UniqueName: \"kubernetes.io/projected/b3cf9d4e-e192-4f08-b0cd-4a417f083f50-kube-api-access-2t9nf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:12.836170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.836082    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:12.859314 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.859282    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"
Oct 30 11:20:12.944802 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:12.944772    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-collector-e4cadd38: configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:20:12.945043 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:12.945024    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal podName:67fafa17-8d7b-4bbf-bef5-4e09a85c05f5 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:13.444998416 +0000 UTC m=+2109.790590252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otc-internal" (UniqueName: "kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal") pod "data-science-collector-collector-0" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5") : configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:20:12.966987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.966936    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"]
Oct 30 11:20:12.968562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.968538    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-qxfzk"]
Oct 30 11:20:12.997059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.997033    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:12.997233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:12.997207    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="52a629b1-4549-435d-a374-bc6bcfb81c4e" containerName="perses" containerID="cri-o://8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543" gracePeriod=30
Oct 30 11:20:13.011466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.011444    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:13.011649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.011626    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" podUID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" containerName="ta-container" containerID="cri-o://d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b" gracePeriod=30
Oct 30 11:20:13.273336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.273313    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:13.276107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.276088    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:13.346913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.346891    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\" (UniqueName: \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\") pod \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") "
Oct 30 11:20:13.347054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.346940    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\" (UniqueName: \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\") pod \"52a629b1-4549-435d-a374-bc6bcfb81c4e\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") "
Oct 30 11:20:13.347054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.346992    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\" (UniqueName: \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\") pod \"52a629b1-4549-435d-a374-bc6bcfb81c4e\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") "
Oct 30 11:20:13.347054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347011    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\") pod \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") "
Oct 30 11:20:13.347224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347088    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"52a629b1-4549-435d-a374-bc6bcfb81c4e\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") "
Oct 30 11:20:13.347224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347144    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\" (UniqueName: \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\") pod \"52a629b1-4549-435d-a374-bc6bcfb81c4e\" (UID: \"52a629b1-4549-435d-a374-bc6bcfb81c4e\") "
Oct 30 11:20:13.347224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347192    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\") pod \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\" (UID: \"4f2549d6-9c25-436c-bd0a-7bd97711ca5d\") "
Oct 30 11:20:13.347621 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347592    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config" pod "52a629b1-4549-435d-a374-bc6bcfb81c4e" (UID: "52a629b1-4549-435d-a374-bc6bcfb81c4e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:13.347621 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347608    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal" pod "4f2549d6-9c25-436c-bd0a-7bd97711ca5d" (UID: "4f2549d6-9c25-436c-bd0a-7bd97711ca5d"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:13.347897 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347845    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.348004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.347899    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a629b1-4549-435d-a374-bc6bcfb81c4e-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.349386 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.349326    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert" pod "4f2549d6-9c25-436c-bd0a-7bd97711ca5d" (UID: "4f2549d6-9c25-436c-bd0a-7bd97711ca5d"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:13.349569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.349544    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq" pod "52a629b1-4549-435d-a374-bc6bcfb81c4e" (UID: "52a629b1-4549-435d-a374-bc6bcfb81c4e"). InnerVolumeSpecName "kube-api-access-lpspq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:13.349662 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.349576    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn" pod "4f2549d6-9c25-436c-bd0a-7bd97711ca5d" (UID: "4f2549d6-9c25-436c-bd0a-7bd97711ca5d"). InnerVolumeSpecName "kube-api-access-whnxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:13.350071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.350052    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "52a629b1-4549-435d-a374-bc6bcfb81c4e" (UID: "52a629b1-4549-435d-a374-bc6bcfb81c4e"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:20:13.448484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.448454    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whnxn\" (UniqueName: \"kubernetes.io/projected/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-kube-api-access-whnxn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.448484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.448479    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpspq\" (UniqueName: \"kubernetes.io/projected/52a629b1-4549-435d-a374-bc6bcfb81c4e-kube-api-access-lpspq\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.448687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.448490    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4f2549d6-9c25-436c-bd0a-7bd97711ca5d-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.448687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.448515    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:20:13.448687 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:13.448553    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-collector-e4cadd38: configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:20:13.448687 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:13.448622    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal podName:67fafa17-8d7b-4bbf-bef5-4e09a85c05f5 nodeName:}" failed. No retries permitted until 2026-10-30 11:20:14.448603133 +0000 UTC m=+2110.794194965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "otc-internal" (UniqueName: "kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal") pod "data-science-collector-collector-0" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5") : configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:20:13.461082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.461067    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:20:13.501054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.501027    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins" pod "52a629b1-4549-435d-a374-bc6bcfb81c4e" (UID: "52a629b1-4549-435d-a374-bc6bcfb81c4e"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:20:13.549511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.549485    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/52a629b1-4549-435d-a374-bc6bcfb81c4e-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:13.549511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.549509    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:20:13.803545 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.803463    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3cf9d4e-e192-4f08-b0cd-4a417f083f50" path="/var/lib/kubelet/pods/b3cf9d4e-e192-4f08-b0cd-4a417f083f50/volumes"
Oct 30 11:20:13.864922 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.864889    4488 generic.go:356] "Generic (PLEG): container finished" podID="52a629b1-4549-435d-a374-bc6bcfb81c4e" containerID="8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543" exitCode=0
Oct 30 11:20:13.865358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.864934    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:13.865358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.864970    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"52a629b1-4549-435d-a374-bc6bcfb81c4e","Type":"ContainerDied","Data":"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"}
Oct 30 11:20:13.865358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.865020    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"52a629b1-4549-435d-a374-bc6bcfb81c4e","Type":"ContainerDied","Data":"32b94b441cb4d5db44884ecd3daaa020d4eb1d175fc96cc340c3556e7a60ae3e"}
Oct 30 11:20:13.865358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.865042    4488 scope.go:122] "RemoveContainer" containerID="8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"
Oct 30 11:20:13.866833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.866811    4488 generic.go:356] "Generic (PLEG): container finished" podID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" containerID="d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b" exitCode=0
Oct 30 11:20:13.866948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.866865    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"
Oct 30 11:20:13.866948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.866939    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" event={"ID":"4f2549d6-9c25-436c-bd0a-7bd97711ca5d","Type":"ContainerDied","Data":"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"}
Oct 30 11:20:13.867075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.866970    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89" event={"ID":"4f2549d6-9c25-436c-bd0a-7bd97711ca5d","Type":"ContainerDied","Data":"d8c6871992893a4065ea275ac5b3b425f849c45142341db936a23bb0dd65bafd"}
Oct 30 11:20:13.867407 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.867379    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" containerName="otc-container" containerID="cri-o://de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde" gracePeriod=30
Oct 30 11:20:13.874312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.874282    4488 scope.go:122] "RemoveContainer" containerID="8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"
Oct 30 11:20:13.874621 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:13.874603    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543\": container with ID starting with 8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543 not found: ID does not exist" containerID="8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"
Oct 30 11:20:13.874727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.874629    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543"} err="failed to get container status \"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543\": rpc error: code = NotFound desc = could not find container \"8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543\": container with ID starting with 8b4c3ffb88825355862619245dc71e19d1b7933fcc6235fce3c8c07039074543 not found: ID does not exist"
Oct 30 11:20:13.874727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.874645    4488 scope.go:122] "RemoveContainer" containerID="d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"
Oct 30 11:20:13.883801 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.883784    4488 scope.go:122] "RemoveContainer" containerID="d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"
Oct 30 11:20:13.884100 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:13.884079    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b\": container with ID starting with d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b not found: ID does not exist" containerID="d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"
Oct 30 11:20:13.884176 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.884109    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b"} err="failed to get container status \"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b\": rpc error: code = NotFound desc = could not find container \"d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b\": container with ID starting with d919322c928c9c3a6e9c9315570d74c2ed0820c380511c06bec966b69ef0f53b not found: ID does not exist"
Oct 30 11:20:13.921605 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.921581    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:13.923485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:13.923467    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-685d5d858b-8gp89"]
Oct 30 11:20:14.014636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.014608    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:14.018385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.018363    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:14.099708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.099686    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:14.257534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257438    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\" (UniqueName: \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\") pod \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") "
Oct 30 11:20:14.257534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257530    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\" (UniqueName: \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\") pod \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") "
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257583    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\") pod \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") "
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257645    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\") pod \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") "
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257674    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\") pod \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\" (UID: \"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5\") "
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.257932    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal" pod "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.259656    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs" pod "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.259666    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert" pod "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.259726    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs" pod "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:20:14.287077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.259780    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p" pod "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" (UID: "67fafa17-8d7b-4bbf-bef5-4e09a85c05f5"). InnerVolumeSpecName "kube-api-access-2jz5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:14.358398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.358331    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:14.358398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.358369    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:14.358398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.358379    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:14.358398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.358389    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:14.358398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.358397    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jz5p\" (UniqueName: \"kubernetes.io/projected/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5-kube-api-access-2jz5p\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:14.874585 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.874550    4488 generic.go:356] "Generic (PLEG): container finished" podID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" containerID="de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde" exitCode=0
Oct 30 11:20:14.874585 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.874585    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5","Type":"ContainerDied","Data":"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"}
Oct 30 11:20:14.875089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.874598    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 11:20:14.875089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.874622    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67fafa17-8d7b-4bbf-bef5-4e09a85c05f5","Type":"ContainerDied","Data":"ee45a66c0f3e4c1a8ff41ac8906d7bb71dc631acd2a59ed779a5d242960b5b06"}
Oct 30 11:20:14.875089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.874644    4488 scope.go:122] "RemoveContainer" containerID="de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"
Oct 30 11:20:14.882996 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.882980    4488 scope.go:122] "RemoveContainer" containerID="de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"
Oct 30 11:20:14.883261 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:14.883241    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde\": container with ID starting with de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde not found: ID does not exist" containerID="de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"
Oct 30 11:20:14.883361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.883268    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde"} err="failed to get container status \"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde\": rpc error: code = NotFound desc = could not find container \"de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde\": container with ID starting with de936fc6ce0eb27f11056e9a02629a3d6f77cdd8cd2180a5c69af427b7c3bdde not found: ID does not exist"
Oct 30 11:20:14.930256 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.930235    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:14.944084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:14.944061    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 11:20:15.801632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:15.801602    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" path="/var/lib/kubelet/pods/4f2549d6-9c25-436c-bd0a-7bd97711ca5d/volumes"
Oct 30 11:20:15.802037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:15.802021    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="52a629b1-4549-435d-a374-bc6bcfb81c4e" path="/var/lib/kubelet/pods/52a629b1-4549-435d-a374-bc6bcfb81c4e/volumes"
Oct 30 11:20:15.802380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:15.802367    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" path="/var/lib/kubelet/pods/67fafa17-8d7b-4bbf-bef5-4e09a85c05f5/volumes"
Oct 30 11:20:18.832288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832214    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832517    4488 cpu_manager.go:414] "containerMap: removing container" podUID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" containerName="ta-container"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832530    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" containerName="ta-container"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832552    4488 cpu_manager.go:414] "containerMap: removing container" podUID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" containerName="otc-container"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832557    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" containerName="otc-container"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832566    4488 cpu_manager.go:414] "containerMap: removing container" podUID="52a629b1-4549-435d-a374-bc6bcfb81c4e" containerName="perses"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832571    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52a629b1-4549-435d-a374-bc6bcfb81c4e" containerName="perses"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832612    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="67fafa17-8d7b-4bbf-bef5-4e09a85c05f5" containerName="otc-container"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832620    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="52a629b1-4549-435d-a374-bc6bcfb81c4e" containerName="perses"
Oct 30 11:20:18.832667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.832627    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f2549d6-9c25-436c-bd0a-7bd97711ca5d" containerName="ta-container"
Oct 30 11:20:18.837038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.837020    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:18.851674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.851646    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:18.864677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.864656    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:20:18.864784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.864764    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:20:18.864827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.864791    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:20:18.991910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:18.991877    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6f6\" (UniqueName: \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968\" (UID: \"c750283f-c425-4b6d-88bd-dbd65839cd90\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:19.092313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.092241    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6f6\" (UniqueName: \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968\" (UID: \"c750283f-c425-4b6d-88bd-dbd65839cd90\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:19.117053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.117033    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6f6\" (UniqueName: \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968\" (UID: \"c750283f-c425-4b6d-88bd-dbd65839cd90\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:19.148031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.147997    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:19.443045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.443023    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:19.445536 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:19.445513    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc750283f_c425_4b6d_88bd_dbd65839cd90.slice/crio-b7d6637ca48e980678d84ad323a5efd2fe7ccf91b807d95d6b6d0a80bf376ef7 WatchSource:0}: Error finding container b7d6637ca48e980678d84ad323a5efd2fe7ccf91b807d95d6b6d0a80bf376ef7: Status 404 returned error can't find the container with id b7d6637ca48e980678d84ad323a5efd2fe7ccf91b807d95d6b6d0a80bf376ef7
Oct 30 11:20:19.840748 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.840673    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:19.844297 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.844275    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:19.860525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.860502    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:19.863667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.863647    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:19.875280 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.875259    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:19.884517 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.884496    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:19.898556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.898532    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" event={"ID":"c750283f-c425-4b6d-88bd-dbd65839cd90","Type":"ContainerStarted","Data":"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"}
Oct 30 11:20:19.898663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.898565    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" event={"ID":"c750283f-c425-4b6d-88bd-dbd65839cd90","Type":"ContainerStarted","Data":"b7d6637ca48e980678d84ad323a5efd2fe7ccf91b807d95d6b6d0a80bf376ef7"}
Oct 30 11:20:19.920231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.920204    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:20:19.924080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.924059    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:19.934972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.934947    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:20:19.939927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.939909    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:20:19.940046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.939939    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:20:19.940046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940022    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:20:19.940167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940045    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-rcknf\""
Oct 30 11:20:19.940167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940129    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:20:19.940270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940195    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:20:19.940873 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940856    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:20:19.940955 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.940883    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:20:19.947902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.947884    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-5qd9c\""
Oct 30 11:20:19.963312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:19.963272    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" podStartSLOduration=1.963260598 podStartE2EDuration="1.963260598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:19.96217033 +0000 UTC m=+2116.307762185" watchObservedRunningTime="2026-10-30 11:20:19.963260598 +0000 UTC m=+2116.308852443"
Oct 30 11:20:20.000262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000239    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.000416 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000281    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.000416 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000313    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.000506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000473    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.000547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000517    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.000592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000544    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.000660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000641    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c428t\" (UniqueName: \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.000696 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000672    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx9gn\" (UniqueName: \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.000743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000703    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gq7f\" (UniqueName: \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.000789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000760    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.000836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.000819    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.101453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101380    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gq7f\" (UniqueName: \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.101453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101412    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.101453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101435    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101464    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101483    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101502    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101620    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101665    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.101723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101693    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.102048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101770    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c428t\" (UniqueName: \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.102048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101796    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx9gn\" (UniqueName: \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.102048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.101919    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.102292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.102270    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.102386 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.102270    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.102482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.102458    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.104055 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.104027    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.104055 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.104041    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.104210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.104105    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.104299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.104283    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.127468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.127447    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx9gn\" (UniqueName: \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\") pod \"data-science-collector-targetallocator-5b4b7f7fb4-6cmz6\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.127562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.127515    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gq7f\" (UniqueName: \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:20.127721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.127704    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c428t\" (UniqueName: \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\") pod \"data-science-collector-collector-1\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.157511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.157490    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:20:20.238653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.238622    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.456606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.456582    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:20:20.458800 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:20.458774    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a22036_e529_47b3_99d3_90253759d003.slice/crio-0eab353dd101d9fc4ca71fc27fadbf8acd75a06261c2e85363ac11444225c49c WatchSource:0}: Error finding container 0eab353dd101d9fc4ca71fc27fadbf8acd75a06261c2e85363ac11444225c49c: Status 404 returned error can't find the container with id 0eab353dd101d9fc4ca71fc27fadbf8acd75a06261c2e85363ac11444225c49c
Oct 30 11:20:20.461206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.461171    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:20.461300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.461228    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:20.533744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.533720    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:20:20.535619 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:20.535594    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9a32c06_73fd_480a_9620_585bfb789872.slice/crio-b00e8caef70c1b0e2585f40200f466ab20fe6aaaf42b089c310981e4c8930745 WatchSource:0}: Error finding container b00e8caef70c1b0e2585f40200f466ab20fe6aaaf42b089c310981e4c8930745: Status 404 returned error can't find the container with id b00e8caef70c1b0e2585f40200f466ab20fe6aaaf42b089c310981e4c8930745
Oct 30 11:20:20.537737 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.537708    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:20.537816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.537762    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:20:20.905008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.904926    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" event={"ID":"f9a32c06-73fd-480a-9620-585bfb789872","Type":"ContainerStarted","Data":"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"}
Oct 30 11:20:20.905008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.904969    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" event={"ID":"f9a32c06-73fd-480a-9620-585bfb789872","Type":"ContainerStarted","Data":"b00e8caef70c1b0e2585f40200f466ab20fe6aaaf42b089c310981e4c8930745"}
Oct 30 11:20:20.905008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.904991    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:20.906052 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.906019    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" podUID="f9a32c06-73fd-480a-9620-585bfb789872" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.147:8080/readyz\": dial tcp 10.133.0.147:8080: connect: connection refused"
Oct 30 11:20:20.906649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.906624    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d8a22036-e529-47b3-99d3-90253759d003","Type":"ContainerStarted","Data":"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"}
Oct 30 11:20:20.906773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.906676    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d8a22036-e529-47b3-99d3-90253759d003","Type":"ContainerStarted","Data":"0eab353dd101d9fc4ca71fc27fadbf8acd75a06261c2e85363ac11444225c49c"}
Oct 30 11:20:20.950262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.950223    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" podStartSLOduration=1.950210362 podStartE2EDuration="1.950210362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:20.949007882 +0000 UTC m=+2117.294599739" watchObservedRunningTime="2026-10-30 11:20:20.950210362 +0000 UTC m=+2117.295802216"
Oct 30 11:20:20.994872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:20.994830    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.994820826 podStartE2EDuration="1.994820826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:20.993870198 +0000 UTC m=+2117.339462045" watchObservedRunningTime="2026-10-30 11:20:20.994820826 +0000 UTC m=+2117.340412673"
Oct 30 11:20:21.912329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:21.912300    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:20:22.266291 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.266258    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:20:22.269482 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.269465    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:20:22.286268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.286242    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:20:22.317683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.317656    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v8zl\" (UniqueName: \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr\" (UID: \"8998cd12-5003-43fc-aa1a-0dfdd2f463d9\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:20:22.418244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.418214    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v8zl\" (UniqueName: \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr\" (UID: \"8998cd12-5003-43fc-aa1a-0dfdd2f463d9\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:20:22.444617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.444588    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v8zl\" (UniqueName: \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr\" (UID: \"8998cd12-5003-43fc-aa1a-0dfdd2f463d9\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:20:22.581192 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.581140    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:20:22.874057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.874032    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:20:22.917241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:22.917216    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" event={"ID":"8998cd12-5003-43fc-aa1a-0dfdd2f463d9","Type":"ContainerStarted","Data":"debc03de9d288a4c5403de123524e0c3e2ad368e903456e487c070c3e108e257"}
Oct 30 11:20:23.923384 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:23.923307    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" event={"ID":"8998cd12-5003-43fc-aa1a-0dfdd2f463d9","Type":"ContainerStarted","Data":"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"}
Oct 30 11:20:23.966377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:23.965960    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" podStartSLOduration=1.9659440689999998 podStartE2EDuration="1.965944069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:23.965279144 +0000 UTC m=+2120.310870998" watchObservedRunningTime="2026-10-30 11:20:23.965944069 +0000 UTC m=+2120.311535925"
Oct 30 11:20:23.997810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:23.997779    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:23.997960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:23.997939    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" podUID="c750283f-c425-4b6d-88bd-dbd65839cd90" containerName="thanos-querier" containerID="cri-o://07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e" gracePeriod=30
Oct 30 11:20:24.232219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.232196    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:24.333147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.333117    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\" (UniqueName: \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\") pod \"c750283f-c425-4b6d-88bd-dbd65839cd90\" (UID: \"c750283f-c425-4b6d-88bd-dbd65839cd90\") "
Oct 30 11:20:24.335005 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.334982    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6" pod "c750283f-c425-4b6d-88bd-dbd65839cd90" (UID: "c750283f-c425-4b6d-88bd-dbd65839cd90"). InnerVolumeSpecName "kube-api-access-nz6f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:20:24.433826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.433797    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz6f6\" (UniqueName: \"kubernetes.io/projected/c750283f-c425-4b6d-88bd-dbd65839cd90-kube-api-access-nz6f6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:20:24.929877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.929843    4488 generic.go:356] "Generic (PLEG): container finished" podID="c750283f-c425-4b6d-88bd-dbd65839cd90" containerID="07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e" exitCode=0
Oct 30 11:20:24.930264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.929891    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"
Oct 30 11:20:24.930264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.929931    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" event={"ID":"c750283f-c425-4b6d-88bd-dbd65839cd90","Type":"ContainerDied","Data":"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"}
Oct 30 11:20:24.930264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.929976    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968" event={"ID":"c750283f-c425-4b6d-88bd-dbd65839cd90","Type":"ContainerDied","Data":"b7d6637ca48e980678d84ad323a5efd2fe7ccf91b807d95d6b6d0a80bf376ef7"}
Oct 30 11:20:24.930264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.929998    4488 scope.go:122] "RemoveContainer" containerID="07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"
Oct 30 11:20:24.938751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.938733    4488 scope.go:122] "RemoveContainer" containerID="07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"
Oct 30 11:20:24.939010 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:24.938991    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e\": container with ID starting with 07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e not found: ID does not exist" containerID="07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"
Oct 30 11:20:24.939075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.939023    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e"} err="failed to get container status \"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e\": rpc error: code = NotFound desc = could not find container \"07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e\": container with ID starting with 07ac4168e5e7cac986b6d5d4eba5fc99602aead61720b4c166549e1040ce416e not found: ID does not exist"
Oct 30 11:20:24.985085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.985060    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:24.988795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:24.988775    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp968"]
Oct 30 11:20:25.802765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:25.802734    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c750283f-c425-4b6d-88bd-dbd65839cd90" path="/var/lib/kubelet/pods/c750283f-c425-4b6d-88bd-dbd65839cd90/volumes"
Oct 30 11:20:27.868168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:27.868135    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:27.900491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:27.900466    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:27.969074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:27.969044    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:27.969233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:27.969171    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:27.987158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:27.987134    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:28.088773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.088751    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:28.119483 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.119427    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:28.275060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.275032    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:28.570874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.570849    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:20:28.573003 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:20:28.572977    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd66635e3_d2d8_444b_9628_034046f74dea.slice/crio-4c4aad417338c650d4499b6c05640a5d0338dadd884632202b7b030da7adbac2 WatchSource:0}: Error finding container 4c4aad417338c650d4499b6c05640a5d0338dadd884632202b7b030da7adbac2: Status 404 returned error can't find the container with id 4c4aad417338c650d4499b6c05640a5d0338dadd884632202b7b030da7adbac2
Oct 30 11:20:28.951885 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.951852    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"d66635e3-d2d8-444b-9628-034046f74dea","Type":"ContainerStarted","Data":"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"}
Oct 30 11:20:28.952271 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.951901    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:20:28.952271 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.951915    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"d66635e3-d2d8-444b-9628-034046f74dea","Type":"ContainerStarted","Data":"4c4aad417338c650d4499b6c05640a5d0338dadd884632202b7b030da7adbac2"}
Oct 30 11:20:28.994520 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:28.994463    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=9.994447331 podStartE2EDuration="9.994447331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:20:28.994295809 +0000 UTC m=+2125.339887664" watchObservedRunningTime="2026-10-30 11:20:28.994447331 +0000 UTC m=+2125.340039189"
Oct 30 11:20:31.479944 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:20:31.479901    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:20:39.960593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:20:39.960561    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:21:01.477901 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:01.477862    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:21:04.619078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:04.619047    4488 scope.go:122] "RemoveContainer" containerID="e0c004b7e12a1eced6d9f507dd49ecfa9b10491c9557222321728e4e6dfed67a"
Oct 30 11:21:27.585680 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:27.585648    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:21:27.586230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:27.585813    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" podUID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" containerName="thanos-querier" containerID="cri-o://1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b" gracePeriod=30
Oct 30 11:21:27.847831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:27.847780    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:21:27.910098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:27.910075    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\" (UniqueName: \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\") pod \"8998cd12-5003-43fc-aa1a-0dfdd2f463d9\" (UID: \"8998cd12-5003-43fc-aa1a-0dfdd2f463d9\") "
Oct 30 11:21:27.912091 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:27.912066    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl" pod "8998cd12-5003-43fc-aa1a-0dfdd2f463d9" (UID: "8998cd12-5003-43fc-aa1a-0dfdd2f463d9"). InnerVolumeSpecName "kube-api-access-7v8zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:21:28.011317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.011292    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v8zl\" (UniqueName: \"kubernetes.io/projected/8998cd12-5003-43fc-aa1a-0dfdd2f463d9-kube-api-access-7v8zl\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.201328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.201289    4488 generic.go:356] "Generic (PLEG): container finished" podID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" containerID="1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b" exitCode=0
Oct 30 11:21:28.201507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.201376    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"
Oct 30 11:21:28.201507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.201380    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" event={"ID":"8998cd12-5003-43fc-aa1a-0dfdd2f463d9","Type":"ContainerDied","Data":"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"}
Oct 30 11:21:28.201507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.201440    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr" event={"ID":"8998cd12-5003-43fc-aa1a-0dfdd2f463d9","Type":"ContainerDied","Data":"debc03de9d288a4c5403de123524e0c3e2ad368e903456e487c070c3e108e257"}
Oct 30 11:21:28.201507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.201459    4488 scope.go:122] "RemoveContainer" containerID="1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"
Oct 30 11:21:28.210104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.210091    4488 scope.go:122] "RemoveContainer" containerID="1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"
Oct 30 11:21:28.210414 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:28.210394    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b\": container with ID starting with 1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b not found: ID does not exist" containerID="1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"
Oct 30 11:21:28.210498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.210427    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b"} err="failed to get container status \"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b\": rpc error: code = NotFound desc = could not find container \"1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b\": container with ID starting with 1987f1cc4c46cb38a3d6ef9dfd77530d543ce2fa3c1b956f3b7dbbb139997d0b not found: ID does not exist"
Oct 30 11:21:28.255060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.255037    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:21:28.261075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.261056    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-p6gxr"]
Oct 30 11:21:28.356216 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.356180    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:21:28.356666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.356632    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="d8a22036-e529-47b3-99d3-90253759d003" containerName="otc-container" containerID="cri-o://98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986" gracePeriod=30
Oct 30 11:21:28.411635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.411592    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:21:28.411818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.411784    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" podUID="f9a32c06-73fd-480a-9620-585bfb789872" containerName="ta-container" containerID="cri-o://b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3" gracePeriod=30
Oct 30 11:21:28.515264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.515180    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:21:28.515476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.515445    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="d66635e3-d2d8-444b-9628-034046f74dea" containerName="perses" containerID="cri-o://c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962" gracePeriod=30
Oct 30 11:21:28.702020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.701997    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:21:28.705102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.705081    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:21:28.771620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.771569    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:21:28.819504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819473    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\") pod \"d66635e3-d2d8-444b-9628-034046f74dea\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") "
Oct 30 11:21:28.819634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819518    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\") pod \"f9a32c06-73fd-480a-9620-585bfb789872\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") "
Oct 30 11:21:28.819634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819549    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\") pod \"d8a22036-e529-47b3-99d3-90253759d003\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") "
Oct 30 11:21:28.819634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819580    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\" (UniqueName: \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\") pod \"d8a22036-e529-47b3-99d3-90253759d003\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") "
Oct 30 11:21:28.819634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819603    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\") pod \"f9a32c06-73fd-480a-9620-585bfb789872\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") "
Oct 30 11:21:28.819877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819696    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"d66635e3-d2d8-444b-9628-034046f74dea\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") "
Oct 30 11:21:28.819939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819897    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\" (UniqueName: \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\") pod \"d66635e3-d2d8-444b-9628-034046f74dea\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") "
Oct 30 11:21:28.819997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.819947    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\" (UniqueName: \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\") pod \"d8a22036-e529-47b3-99d3-90253759d003\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") "
Oct 30 11:21:28.820052 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.820000    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal" pod "d8a22036-e529-47b3-99d3-90253759d003" (UID: "d8a22036-e529-47b3-99d3-90253759d003"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:21:28.820052 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.820009    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal" pod "f9a32c06-73fd-480a-9620-585bfb789872" (UID: "f9a32c06-73fd-480a-9620-585bfb789872"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:21:28.820052 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.820018    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\") pod \"d8a22036-e529-47b3-99d3-90253759d003\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") "
Oct 30 11:21:28.820379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.820325    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\") pod \"d8a22036-e529-47b3-99d3-90253759d003\" (UID: \"d8a22036-e529-47b3-99d3-90253759d003\") "
Oct 30 11:21:28.820497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.820399    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\" (UniqueName: \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\") pod \"d66635e3-d2d8-444b-9628-034046f74dea\" (UID: \"d66635e3-d2d8-444b-9628-034046f74dea\") "
Oct 30 11:21:28.822166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.821750    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\" (UniqueName: \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\") pod \"f9a32c06-73fd-480a-9620-585bfb789872\" (UID: \"f9a32c06-73fd-480a-9620-585bfb789872\") "
Oct 30 11:21:28.822166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.821962    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config" pod "d66635e3-d2d8-444b-9628-034046f74dea" (UID: "d66635e3-d2d8-444b-9628-034046f74dea"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:21:28.822334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.822270    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d8a22036-e529-47b3-99d3-90253759d003-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.822334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.822293    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f9a32c06-73fd-480a-9620-585bfb789872-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.822334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.822306    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d66635e3-d2d8-444b-9628-034046f74dea-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.823157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823122    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t" pod "d8a22036-e529-47b3-99d3-90253759d003" (UID: "d8a22036-e529-47b3-99d3-90253759d003"). InnerVolumeSpecName "kube-api-access-c428t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:21:28.823317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823296    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "d66635e3-d2d8-444b-9628-034046f74dea" (UID: "d66635e3-d2d8-444b-9628-034046f74dea"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:21:28.823418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823318    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f" pod "d66635e3-d2d8-444b-9628-034046f74dea" (UID: "d66635e3-d2d8-444b-9628-034046f74dea"). InnerVolumeSpecName "kube-api-access-8gq7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:21:28.823479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823433    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs" pod "d8a22036-e529-47b3-99d3-90253759d003" (UID: "d8a22036-e529-47b3-99d3-90253759d003"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:21:28.823616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823595    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs" pod "d8a22036-e529-47b3-99d3-90253759d003" (UID: "d8a22036-e529-47b3-99d3-90253759d003"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:21:28.823616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823605    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert" pod "f9a32c06-73fd-480a-9620-585bfb789872" (UID: "f9a32c06-73fd-480a-9620-585bfb789872"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:21:28.823725 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.823682    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert" pod "d8a22036-e529-47b3-99d3-90253759d003" (UID: "d8a22036-e529-47b3-99d3-90253759d003"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:21:28.824069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.824050    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn" pod "f9a32c06-73fd-480a-9620-585bfb789872" (UID: "f9a32c06-73fd-480a-9620-585bfb789872"). InnerVolumeSpecName "kube-api-access-dx9gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:21:28.922796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922768    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922794    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922803    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx9gn\" (UniqueName: \"kubernetes.io/projected/f9a32c06-73fd-480a-9620-585bfb789872-kube-api-access-dx9gn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922814    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f9a32c06-73fd-480a-9620-585bfb789872-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922824    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d8a22036-e529-47b3-99d3-90253759d003-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922854    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922863    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gq7f\" (UniqueName: \"kubernetes.io/projected/d66635e3-d2d8-444b-9628-034046f74dea-kube-api-access-8gq7f\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.922968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.922872    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c428t\" (UniqueName: \"kubernetes.io/projected/d8a22036-e529-47b3-99d3-90253759d003-kube-api-access-c428t\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:28.935027 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.935007    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:21:28.970425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:28.970384    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins" pod "d66635e3-d2d8-444b-9628-034046f74dea" (UID: "d66635e3-d2d8-444b-9628-034046f74dea"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:21:29.023612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.023559    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/d66635e3-d2d8-444b-9628-034046f74dea-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:29.023612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.023583    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:21:29.207260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.207224    4488 generic.go:356] "Generic (PLEG): container finished" podID="f9a32c06-73fd-480a-9620-585bfb789872" containerID="b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3" exitCode=0
Oct 30 11:21:29.207452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.207272    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"
Oct 30 11:21:29.207452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.207307    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" event={"ID":"f9a32c06-73fd-480a-9620-585bfb789872","Type":"ContainerDied","Data":"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"}
Oct 30 11:21:29.207452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.207368    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6" event={"ID":"f9a32c06-73fd-480a-9620-585bfb789872","Type":"ContainerDied","Data":"b00e8caef70c1b0e2585f40200f466ab20fe6aaaf42b089c310981e4c8930745"}
Oct 30 11:21:29.207452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.207391    4488 scope.go:122] "RemoveContainer" containerID="b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"
Oct 30 11:21:29.208731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.208708    4488 generic.go:356] "Generic (PLEG): container finished" podID="d8a22036-e529-47b3-99d3-90253759d003" containerID="98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986" exitCode=0
Oct 30 11:21:29.208821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.208735    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d8a22036-e529-47b3-99d3-90253759d003","Type":"ContainerDied","Data":"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"}
Oct 30 11:21:29.208821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.208769    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:21:29.208821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.208794    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"d8a22036-e529-47b3-99d3-90253759d003","Type":"ContainerDied","Data":"0eab353dd101d9fc4ca71fc27fadbf8acd75a06261c2e85363ac11444225c49c"}
Oct 30 11:21:29.213648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.213616    4488 generic.go:356] "Generic (PLEG): container finished" podID="d66635e3-d2d8-444b-9628-034046f74dea" containerID="c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962" exitCode=0
Oct 30 11:21:29.213760 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.213723    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"d66635e3-d2d8-444b-9628-034046f74dea","Type":"ContainerDied","Data":"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"}
Oct 30 11:21:29.213829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.213765    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"d66635e3-d2d8-444b-9628-034046f74dea","Type":"ContainerDied","Data":"4c4aad417338c650d4499b6c05640a5d0338dadd884632202b7b030da7adbac2"}
Oct 30 11:21:29.213878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.213846    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:21:29.222129 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.222086    4488 scope.go:122] "RemoveContainer" containerID="b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"
Oct 30 11:21:29.222627 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:29.222586    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3\": container with ID starting with b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3 not found: ID does not exist" containerID="b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"
Oct 30 11:21:29.222827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.222800    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3"} err="failed to get container status \"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3\": rpc error: code = NotFound desc = could not find container \"b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3\": container with ID starting with b82377d818cac198a29ecc4d6efd57869b1f03c49b4b92f6e38b47652ca94dc3 not found: ID does not exist"
Oct 30 11:21:29.222892 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.222829    4488 scope.go:122] "RemoveContainer" containerID="98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"
Oct 30 11:21:29.231396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.231380    4488 scope.go:122] "RemoveContainer" containerID="98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"
Oct 30 11:21:29.231673 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:29.231651    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986\": container with ID starting with 98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986 not found: ID does not exist" containerID="98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"
Oct 30 11:21:29.231716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.231687    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986"} err="failed to get container status \"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986\": rpc error: code = NotFound desc = could not find container \"98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986\": container with ID starting with 98f52ba15309a9689f4c494a482cf4924e6843511dbbc6a7b1e32ec6caae8986 not found: ID does not exist"
Oct 30 11:21:29.231716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.231706    4488 scope.go:122] "RemoveContainer" containerID="c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"
Oct 30 11:21:29.248358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.248329    4488 scope.go:122] "RemoveContainer" containerID="c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"
Oct 30 11:21:29.248687 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:29.248662    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962\": container with ID starting with c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962 not found: ID does not exist" containerID="c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"
Oct 30 11:21:29.248770 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.248701    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962"} err="failed to get container status \"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962\": rpc error: code = NotFound desc = could not find container \"c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962\": container with ID starting with c611afde0a0d03f57bc3e7c27eaeaad45e6730d3cc777c426773be39e600c962 not found: ID does not exist"
Oct 30 11:21:29.262582 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.262556    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:21:29.266797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.266774    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5b4b7f7fb4-6cmz6"]
Oct 30 11:21:29.340287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.340201    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:21:29.346902 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.346875    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:21:29.383858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.383827    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:21:29.387470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.387439    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:21:29.801788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.801752    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" path="/var/lib/kubelet/pods/8998cd12-5003-43fc-aa1a-0dfdd2f463d9/volumes"
Oct 30 11:21:29.802187 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.802167    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d66635e3-d2d8-444b-9628-034046f74dea" path="/var/lib/kubelet/pods/d66635e3-d2d8-444b-9628-034046f74dea/volumes"
Oct 30 11:21:29.802605 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.802588    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8a22036-e529-47b3-99d3-90253759d003" path="/var/lib/kubelet/pods/d8a22036-e529-47b3-99d3-90253759d003/volumes"
Oct 30 11:21:29.803281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:29.803267    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9a32c06-73fd-480a-9620-585bfb789872" path="/var/lib/kubelet/pods/f9a32c06-73fd-480a-9620-585bfb789872/volumes"
Oct 30 11:21:30.103629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.103596    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104035    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c750283f-c425-4b6d-88bd-dbd65839cd90" containerName="thanos-querier"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104059    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c750283f-c425-4b6d-88bd-dbd65839cd90" containerName="thanos-querier"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104100    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d8a22036-e529-47b3-99d3-90253759d003" containerName="otc-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104109    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8a22036-e529-47b3-99d3-90253759d003" containerName="otc-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104119    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" containerName="thanos-querier"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104127    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" containerName="thanos-querier"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104159    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f9a32c06-73fd-480a-9620-585bfb789872" containerName="ta-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104166    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9a32c06-73fd-480a-9620-585bfb789872" containerName="ta-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104181    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d66635e3-d2d8-444b-9628-034046f74dea" containerName="perses"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104188    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d66635e3-d2d8-444b-9628-034046f74dea" containerName="perses"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104250    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8a22036-e529-47b3-99d3-90253759d003" containerName="otc-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104259    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8998cd12-5003-43fc-aa1a-0dfdd2f463d9" containerName="thanos-querier"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104270    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9a32c06-73fd-480a-9620-585bfb789872" containerName="ta-container"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104278    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d66635e3-d2d8-444b-9628-034046f74dea" containerName="perses"
Oct 30 11:21:30.104366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.104286    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c750283f-c425-4b6d-88bd-dbd65839cd90" containerName="thanos-querier"
Oct 30 11:21:30.108699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.108677    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.128328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.128296    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:21:30.131168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.131138    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.131292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.131191    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrmr\" (UniqueName: \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.141090 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.141069    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:21:30.141208 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.141094    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:21:30.141208 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.141187    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:21:30.232267 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.232238    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.232422 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.232282    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrmr\" (UniqueName: \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.232623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.232604    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.257498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.257471    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrmr\" (UniqueName: \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\") pod \"seaweedfs\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.430273 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.430248    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:30.724377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:30.724289    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:21:30.727291 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:30.727262    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca290d4_4612_4776_95eb_f72362336404.slice/crio-9b147a40ad8a7eedae2f338d6b00750ad6979b6d13ebd096e178a8cad42446c3 WatchSource:0}: Error finding container 9b147a40ad8a7eedae2f338d6b00750ad6979b6d13ebd096e178a8cad42446c3: Status 404 returned error can't find the container with id 9b147a40ad8a7eedae2f338d6b00750ad6979b6d13ebd096e178a8cad42446c3
Oct 30 11:21:31.226968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:31.226932    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"dca290d4-4612-4776-95eb-f72362336404","Type":"ContainerStarted","Data":"da9a6cf3f2991ef0b210c47b61c3d86dc7c12d7795aed29ab99918b2a199cc02"}
Oct 30 11:21:31.227334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:31.226978    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"dca290d4-4612-4776-95eb-f72362336404","Type":"ContainerStarted","Data":"9b147a40ad8a7eedae2f338d6b00750ad6979b6d13ebd096e178a8cad42446c3"}
Oct 30 11:21:31.227334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:31.227013    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:31.269480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:31.269437    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=1.269422291 podStartE2EDuration="1.269422291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:21:31.268801982 +0000 UTC m=+2187.614393849" watchObservedRunningTime="2026-10-30 11:21:31.269422291 +0000 UTC m=+2187.615014150"
Oct 30 11:21:31.478205 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:21:31.478120    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:21:42.231910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:42.231883    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:21:44.302084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.302049    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:21:44.305617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.305594    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:44.321805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.321782    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:21:44.440778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.440756    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tw7t\" (UniqueName: \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\") pod \"seaweedfs-bucket-creator\" (UID: \"bfb7faf1-edb1-42d7-af3e-5567df9195fd\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:44.541947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.541926    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tw7t\" (UniqueName: \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\") pod \"seaweedfs-bucket-creator\" (UID: \"bfb7faf1-edb1-42d7-af3e-5567df9195fd\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:44.566978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.566931    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tw7t\" (UniqueName: \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\") pod \"seaweedfs-bucket-creator\" (UID: \"bfb7faf1-edb1-42d7-af3e-5567df9195fd\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:44.616725 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.616706    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:44.908441 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:44.908296    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:21:44.910946 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:44.910920    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb7faf1_edb1_42d7_af3e_5567df9195fd.slice/crio-32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409 WatchSource:0}: Error finding container 32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409: Status 404 returned error can't find the container with id 32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409
Oct 30 11:21:45.288698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:45.288666    4488 generic.go:356] "Generic (PLEG): container finished" podID="bfb7faf1-edb1-42d7-af3e-5567df9195fd" containerID="2af997686404401745abd0405c7d75a65485fe8413bf6424faa344a96560d14c" exitCode=0
Oct 30 11:21:45.288816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:45.288723    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"bfb7faf1-edb1-42d7-af3e-5567df9195fd","Type":"ContainerDied","Data":"2af997686404401745abd0405c7d75a65485fe8413bf6424faa344a96560d14c"}
Oct 30 11:21:45.288816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:45.288749    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"bfb7faf1-edb1-42d7-af3e-5567df9195fd","Type":"ContainerStarted","Data":"32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409"}
Oct 30 11:21:46.416035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:46.416006    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:46.559731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:46.559663    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\" (UniqueName: \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\") pod \"bfb7faf1-edb1-42d7-af3e-5567df9195fd\" (UID: \"bfb7faf1-edb1-42d7-af3e-5567df9195fd\") "
Oct 30 11:21:46.561627 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:46.561597    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t" pod "bfb7faf1-edb1-42d7-af3e-5567df9195fd" (UID: "bfb7faf1-edb1-42d7-af3e-5567df9195fd"). InnerVolumeSpecName "kube-api-access-9tw7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:21:46.660702 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:46.660679    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tw7t\" (UniqueName: \"kubernetes.io/projected/bfb7faf1-edb1-42d7-af3e-5567df9195fd-kube-api-access-9tw7t\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:21:47.299113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:47.299075    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"bfb7faf1-edb1-42d7-af3e-5567df9195fd","Type":"ContainerDied","Data":"32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409"}
Oct 30 11:21:47.299113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:47.299118    4488 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32ea7fd281e6ffe67ff52f245807a8120a0af0e4f0ef792cd4aa4e481674f409"
Oct 30 11:21:47.299325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:47.299094    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 11:21:51.080838 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.080803    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:21:51.081248 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.081233    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bfb7faf1-edb1-42d7-af3e-5567df9195fd" containerName="create-bucket"
Oct 30 11:21:51.081293 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.081250    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfb7faf1-edb1-42d7-af3e-5567df9195fd" containerName="create-bucket"
Oct 30 11:21:51.081382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.081358    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfb7faf1-edb1-42d7-af3e-5567df9195fd" containerName="create-bucket"
Oct 30 11:21:51.084561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.084542    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.102466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.102447    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-http\""
Oct 30 11:21:51.117053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.117018    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ca-bundle\""
Oct 30 11:21:51.118113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.118090    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:21:51.119701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.119685    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-config\""
Oct 30 11:21:51.193967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.193942    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.194068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.193975    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.194068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.194002    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m28l\" (UniqueName: \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.194152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.194074    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.194152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.194126    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.203212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.203192    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-4pmvt\""
Oct 30 11:21:51.203212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.203198    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-grpc\""
Oct 30 11:21:51.295430 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.295398    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.295565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.295437    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.295565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.295477    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m28l\" (UniqueName: \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.295682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.295616    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.295747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.295683    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.296222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.296189    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.296222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.296202    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.297866 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.297839    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.297979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.297874    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.331664 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.331605    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m28l\" (UniqueName: \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\") pod \"data-science-lokistack-distributor-58947679b7-7qplq\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.351434 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.351405    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:21:51.355753 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.355733    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.382821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.382797    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-shared-secret\""
Oct 30 11:21:51.382935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.382816    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-grpc\""
Oct 30 11:21:51.382935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.382842    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-http\""
Oct 30 11:21:51.384048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.384027    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:21:51.396220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.396192    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:51.497313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497275    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.497530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497397    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.497530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497449    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.497671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497553    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.497671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497585    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.497671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.497601    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4h6\" (UniqueName: \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.533926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.533899    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:21:51.538418 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.538397    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.567309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.567280    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:21:51.584609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.584531    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-grpc\""
Oct 30 11:21:51.584609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.584582    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-http\""
Oct 30 11:21:51.598690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598664    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.598816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598695    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2tgt\" (UniqueName: \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.598816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598721    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.598816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598739    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.598816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598784    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4h6\" (UniqueName: \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.599026 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.598824    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.599090 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599071    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.599648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599162    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.599648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599243    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.599648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599283    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.599648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599335    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.599939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599725    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.600001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.599951    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.601515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.601495    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.601943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.601919    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.602222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.602202    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.629212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.629188    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4h6\" (UniqueName: \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\") pod \"data-science-lokistack-querier-84985db556-7bntx\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.667147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.667125    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:51.700248 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.700210    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2tgt\" (UniqueName: \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.700486 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.700274    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.700486 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.700315    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.700486 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.700393    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.700486 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.700493    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.701109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.701075    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.701321 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.701288    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.703496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.703470    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.703919 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.703896    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.704560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.704540    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:21:51.707009 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:51.706986    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192767ba_9495_4897_aa9d_a04a01867585.slice/crio-eedc9c5bebedb1cf6a6bf1a95a2e635974e37d8281fc86f8094cd7837ce3ef10 WatchSource:0}: Error finding container eedc9c5bebedb1cf6a6bf1a95a2e635974e37d8281fc86f8094cd7837ce3ef10: Status 404 returned error can't find the container with id eedc9c5bebedb1cf6a6bf1a95a2e635974e37d8281fc86f8094cd7837ce3ef10
Oct 30 11:21:51.709018 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.708998    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 11:21:51.726835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.726812    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2tgt\" (UniqueName: \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\") pod \"data-science-lokistack-query-frontend-f746fc66d-rd2qj\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.774987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.774959    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:21:51.779460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.779440    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.803785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.803762    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:21:51.849908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.849850    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:51.866380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866330    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-ca-bundle\""
Oct 30 11:21:51.866380 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866372    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 11:21:51.866561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866373    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 11:21:51.866561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866483    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-client-http\""
Oct 30 11:21:51.866561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866323    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-http\""
Oct 30 11:21:51.866717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.866677    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-dockercfg-5r9gx\""
Oct 30 11:21:51.902951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.902924    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.902972    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.902997    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7n8c\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.903032    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.903062    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.903099    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.903145    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.903296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.903206    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:51.976179 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:51.976151    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:21:51.977984 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:51.977960    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ebd321_b1f9_46f2_a7ac_59a8644d94e9.slice/crio-a9ee68e8f9b1b23b604c1a9b948b40e72c555ae0ae5662840561f3a35d5af5e7 WatchSource:0}: Error finding container a9ee68e8f9b1b23b604c1a9b948b40e72c555ae0ae5662840561f3a35d5af5e7: Status 404 returned error can't find the container with id a9ee68e8f9b1b23b604c1a9b948b40e72c555ae0ae5662840561f3a35d5af5e7
Oct 30 11:21:52.004559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004533    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004581    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004616    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004634    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7n8c\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004654    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004688    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004787 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004745    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.004936 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.004791    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.005544 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.005512    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.005544 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.005534    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.005722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.005534    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.007077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.007057    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.007177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.007058    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.007527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.007503    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.007619 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.007603    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.029017 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.028988    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7n8c\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\") pod \"data-science-lokistack-gateway-698f8cbf65-xvdht\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.093029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.093005    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:21:52.155820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.155317    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:21:52.157929 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:52.157907    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68569546_17ad_451a_abbd_252b29111388.slice/crio-00db07de965cd9d4fd685a9f574da35ff43e137926f7afd4287610827d04736d WatchSource:0}: Error finding container 00db07de965cd9d4fd685a9f574da35ff43e137926f7afd4287610827d04736d: Status 404 returned error can't find the container with id 00db07de965cd9d4fd685a9f574da35ff43e137926f7afd4287610827d04736d
Oct 30 11:21:52.326836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.326796    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" event={"ID":"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9","Type":"ContainerStarted","Data":"a9ee68e8f9b1b23b604c1a9b948b40e72c555ae0ae5662840561f3a35d5af5e7"}
Oct 30 11:21:52.327989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.327956    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" event={"ID":"192767ba-9495-4897-aa9d-a04a01867585","Type":"ContainerStarted","Data":"eedc9c5bebedb1cf6a6bf1a95a2e635974e37d8281fc86f8094cd7837ce3ef10"}
Oct 30 11:21:52.329054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.329034    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" event={"ID":"68569546-17ad-451a-abbd-252b29111388","Type":"ContainerStarted","Data":"00db07de965cd9d4fd685a9f574da35ff43e137926f7afd4287610827d04736d"}
Oct 30 11:21:52.394745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:52.394610    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:21:52.397265 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:21:52.397241    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fec47a_6781_494e_bb92_bdad5eac49a9.slice/crio-e4a5a1ec4f03891212e600d7c597b0cd7d9177204e99754ec7ebbe1fe933528f WatchSource:0}: Error finding container e4a5a1ec4f03891212e600d7c597b0cd7d9177204e99754ec7ebbe1fe933528f: Status 404 returned error can't find the container with id e4a5a1ec4f03891212e600d7c597b0cd7d9177204e99754ec7ebbe1fe933528f
Oct 30 11:21:53.336670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:53.336631    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerStarted","Data":"e4a5a1ec4f03891212e600d7c597b0cd7d9177204e99754ec7ebbe1fe933528f"}
Oct 30 11:21:55.349875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.349772    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" event={"ID":"68569546-17ad-451a-abbd-252b29111388","Type":"ContainerStarted","Data":"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"}
Oct 30 11:21:55.350321 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.349968    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:21:55.351863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.351821    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" event={"ID":"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9","Type":"ContainerStarted","Data":"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"}
Oct 30 11:21:55.352013 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.351927    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:21:55.353708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.353681    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerStarted","Data":"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"}
Oct 30 11:21:55.355444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.355416    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" event={"ID":"192767ba-9495-4897-aa9d-a04a01867585","Type":"ContainerStarted","Data":"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"}
Oct 30 11:21:55.355589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.355553    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:21:55.396176 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.396135    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" podStartSLOduration=1.51004564 podStartE2EDuration="4.396121981s" totalImagesPullingTime="2.886076341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:21:55.395398049 +0000 UTC m=+2211.740989903" watchObservedRunningTime="2026-10-30 11:21:55.396121981 +0000 UTC m=+2211.741713835"
Oct 30 11:21:55.449551 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.449509    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" podStartSLOduration=0.990387322 podStartE2EDuration="4.449495741s" totalImagesPullingTime="3.459108419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:21:55.448947265 +0000 UTC m=+2211.794539120" watchObservedRunningTime="2026-10-30 11:21:55.449495741 +0000 UTC m=+2211.795087595"
Oct 30 11:21:55.505751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:21:55.505704    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" podStartSLOduration=1.588111872 podStartE2EDuration="4.505686094s" totalImagesPullingTime="2.917574222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:21:55.504636822 +0000 UTC m=+2211.850228697" watchObservedRunningTime="2026-10-30 11:21:55.505686094 +0000 UTC m=+2211.851277951"
Oct 30 11:22:01.478329 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:22:01.478296    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:22:13.430964 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.430927    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerStarted","Data":"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"}
Oct 30 11:22:13.431529 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.430985    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:22:13.431529 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.431135    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:22:13.436781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.436760    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:22:13.440064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.440045    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:22:13.509074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:13.509031    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" podStartSLOduration=2.026428641 podStartE2EDuration="22.509018668s" totalImagesPullingTime="20.482590027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:21:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:22:13.493953433 +0000 UTC m=+2229.839545287" watchObservedRunningTime="2026-10-30 11:22:13.509018668 +0000 UTC m=+2229.854610521"
Oct 30 11:22:16.365727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:16.365697    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:22:16.366238 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:16.366215    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:22:16.366636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:22:16.366617    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:22:31.478984 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:22:31.478947    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:23:01.478615 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:23:01.478564    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:23:04.678510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:23:04.678481    4488 scope.go:122] "RemoveContainer" containerID="cd933cd1c677c5cf7eda59cc4b2fc9dfe0722d00c622ab41aad39aea5b5ba40e"
Oct 30 11:23:31.478414 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:23:31.478303    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:24:01.477610 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:24:01.477573    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:24:13.924506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:13.924470    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:24:13.927923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:13.927898    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:13.947781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:13.947758    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 11:24:13.962224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:13.962203    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 11:24:13.963616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:13.963587    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:24:14.084016 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.083992    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.084146 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.084041    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.084221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.084160    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.084288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.084239    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rpl\" (UniqueName: \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.084288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.084274    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.084425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.084333    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184731    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rpl\" (UniqueName: \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184766    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184805    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184849    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184903    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.184962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.184941    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.185505 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.185484    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.185661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.185638    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.187300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.187272    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.187432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.187382    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.187522 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.187505    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:14.210488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:14.210467    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rpl\" (UniqueName: \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.333484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.333451    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.333959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.333586    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.366445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.366412    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.366576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.366460    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.434804 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.434779    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.434915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.434819    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.434967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.434909    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.434967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.434935    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.451198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.451176    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") DevicePath \"csi-eb018eb8c11ca00d8d811eb73b56398e204de81e115e3b7ff0d19263934c7c95\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.451198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.451183    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") DevicePath \"csi-0693159d8652ea4188320c174c9a37e3576dd66b8db9b87a46af0a124ffc6c0a\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.680994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.680961    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/b554cdd3f05b8fbf122d7cc95d00498b97c61b4880dd57285f4e89e0d822aafe/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:20.707252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:20.707225    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:27.771739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:27.771710    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/77ed136e3dd92e8583c89d43615042d6e129a92ae818289ba507b9d44ff2235f/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:27.797403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:27.797376    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:28.040043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:28.039962    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:28.354268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:28.354238    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:24:28.356795 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:24:28.356766    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07844bbd_8b31_42ed_8aa5_6bc498cf4f34.slice/crio-70ac02797e75493c879b13e43f5a9af5c42aac2b259edf00b9c9e48c03af28ae WatchSource:0}: Error finding container 70ac02797e75493c879b13e43f5a9af5c42aac2b259edf00b9c9e48c03af28ae: Status 404 returned error can't find the container with id 70ac02797e75493c879b13e43f5a9af5c42aac2b259edf00b9c9e48c03af28ae
Oct 30 11:24:28.980708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:28.980675    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"07844bbd-8b31-42ed-8aa5-6bc498cf4f34","Type":"ContainerStarted","Data":"0358b68be322deb5829707ab32f14ed58b4c341715c4989ae9e3a04776b5d4d4"}
Oct 30 11:24:28.981188 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:28.980730    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"07844bbd-8b31-42ed-8aa5-6bc498cf4f34","Type":"ContainerStarted","Data":"70ac02797e75493c879b13e43f5a9af5c42aac2b259edf00b9c9e48c03af28ae"}
Oct 30 11:24:28.981188 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:28.980811    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:24:29.029218 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:29.029168    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podStartSLOduration=19.029156045 podStartE2EDuration="19.029156045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:24:29.028137867 +0000 UTC m=+2365.373729721" watchObservedRunningTime="2026-10-30 11:24:29.029156045 +0000 UTC m=+2365.374747899"
Oct 30 11:24:31.478755 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:24:31.478717    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:24:49.991111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:49.991069    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:24:59.990038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:24:59.990003    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:25:01.478754 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:25:01.478716    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:25:09.990201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:09.990164    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:25:19.990150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:19.990125    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:31.477983 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:25:31.477943    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:25:34.381470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:34.381431    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:34.381927 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:34.381702    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester" containerID="cri-o://0358b68be322deb5829707ab32f14ed58b4c341715c4989ae9e3a04776b5d4d4" gracePeriod=600
Oct 30 11:25:35.255734 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.255701    4488 generic.go:356] "Generic (PLEG): container finished" podID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerID="0358b68be322deb5829707ab32f14ed58b4c341715c4989ae9e3a04776b5d4d4" exitCode=0
Oct 30 11:25:35.255877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.255756    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"07844bbd-8b31-42ed-8aa5-6bc498cf4f34","Type":"ContainerDied","Data":"0358b68be322deb5829707ab32f14ed58b4c341715c4989ae9e3a04776b5d4d4"}
Oct 30 11:25:35.339977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.339949    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:35.410574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410504    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.410574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410547    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\" (UniqueName: \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.411053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410637    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.411053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410687    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.411053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410718    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.411318 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.410803    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.412448 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.412426    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.412654 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.412636    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\") pod \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\" (UID: \"07844bbd-8b31-42ed-8aa5-6bc498cf4f34\") "
Oct 30 11:25:35.413189 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.411286    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:25:35.413392 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.413187    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:25:35.413538 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.413482    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.413651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.413542    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.413651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.413598    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "test-loki-shared-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:25:35.414301 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.414204    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "kube-api-access-c7rpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:25:35.414572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.414502    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:25:35.415034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.414801    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:25:35.415034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.414885    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:25:35.415034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.415001    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed" pod "07844bbd-8b31-42ed-8aa5-6bc498cf4f34" (UID: "07844bbd-8b31-42ed-8aa5-6bc498cf4f34"). InnerVolumeSpecName "pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:25:35.513940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513918    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.513940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513940    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-data-science-lokistack-ingester-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.514120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513951    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rpl\" (UniqueName: \"kubernetes.io/projected/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-kube-api-access-c7rpl\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.514120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513975    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:25:35.514120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513989    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:25:35.514120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.513998    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/07844bbd-8b31-42ed-8aa5-6bc498cf4f34-test-loki-shared-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:25:35.526015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.525999    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:25:35.528194 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.528172    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:25:35.615348 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.615320    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-0693159d8652ea4188320c174c9a37e3576dd66b8db9b87a46af0a124ffc6c0a\""
Oct 30 11:25:35.615475 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.615363    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-eb018eb8c11ca00d8d811eb73b56398e204de81e115e3b7ff0d19263934c7c95\""
Oct 30 11:25:35.651764 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.651738    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:25:35.652051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.652038    4488 cpu_manager.go:414] "containerMap: removing container" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester"
Oct 30 11:25:35.652107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.652052    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester"
Oct 30 11:25:35.652143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.652121    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" containerName="loki-ingester"
Oct 30 11:25:35.656313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.656290    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.673511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.673478    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-grpc\""
Oct 30 11:25:35.673640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.673526    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 11:25:35.673640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.673526    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-http\""
Oct 30 11:25:35.674168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.674151    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:25:35.716110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716088    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.716230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716130    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwg6j\" (UniqueName: \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.716230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716197    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.716230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716220    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.716375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716256    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.716375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.716366    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.816777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816752    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.816905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816795    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwg6j\" (UniqueName: \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.816905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816817    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.816905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816842    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.816905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816880    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.817121 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.816926    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.817601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.817577    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.817759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.817736    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.819326 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.819296    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.819476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.819410    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.819629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.819610    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:35.841687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:35.841666    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwg6j\" (UniqueName: \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:36.261472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.261447    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.261630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.261473    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"07844bbd-8b31-42ed-8aa5-6bc498cf4f34","Type":"ContainerDied","Data":"70ac02797e75493c879b13e43f5a9af5c42aac2b259edf00b9c9e48c03af28ae"}
Oct 30 11:25:36.261630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.261548    4488 scope.go:122] "RemoveContainer" containerID="0358b68be322deb5829707ab32f14ed58b4c341715c4989ae9e3a04776b5d4d4"
Oct 30 11:25:36.317449 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.317424    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:36.321031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.321010    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:36.359197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.359176    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:36.364427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.364407    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.382315 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.382295    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:36.435089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.435070    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 11:25:36.435412 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.435082    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 11:25:36.521566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521538    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.521712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521570    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.521712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521597    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.521805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521708    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.521805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521753    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.521805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.521795    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.622729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622699    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.622901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622782    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.622901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622813    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.622901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622851    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.622901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622889    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.623119 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.622914    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.623531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.623504    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.623648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.623572    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.625624 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.625601    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.625803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.625779    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.625847 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.625812    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:36.647942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:36.647915    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:37.803063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:37.803028    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07844bbd-8b31-42ed-8aa5-6bc498cf4f34" path="/var/lib/kubelet/pods/07844bbd-8b31-42ed-8aa5-6bc498cf4f34/volumes"
Oct 30 11:25:42.467862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.467831    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.467862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.467865    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.500458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.500434    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.500458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.500437    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.568221 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.568196    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.568322 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.568223    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.568322 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.568309    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.568432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.568318    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.584519 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.584494    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") DevicePath \"csi-eb018eb8c11ca00d8d811eb73b56398e204de81e115e3b7ff0d19263934c7c95\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.584602 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.584494    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") DevicePath \"csi-0693159d8652ea4188320c174c9a37e3576dd66b8db9b87a46af0a124ffc6c0a\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.690917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.690891    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/b554cdd3f05b8fbf122d7cc95d00498b97c61b4880dd57285f4e89e0d822aafe/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.699492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.699470    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/77ed136e3dd92e8583c89d43615042d6e129a92ae818289ba507b9d44ff2235f/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.722099 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.722049    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.724462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.724445    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"data-science-lokistack-ingester-2\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:42.976476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:42.976412    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:43.290377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:43.290323    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:25:43.292434 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:25:43.292410    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2198c987_319c_4bec_a6b5_2b5fe9378f20.slice/crio-57772f03efe42b791ff2e6b2f43a9c5517692b1252e0a2ca0257b269fde92e05 WatchSource:0}: Error finding container 57772f03efe42b791ff2e6b2f43a9c5517692b1252e0a2ca0257b269fde92e05: Status 404 returned error can't find the container with id 57772f03efe42b791ff2e6b2f43a9c5517692b1252e0a2ca0257b269fde92e05
Oct 30 11:25:44.296389 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:44.296327    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"2198c987-319c-4bec-a6b5-2b5fe9378f20","Type":"ContainerStarted","Data":"8d14c745b87edf7b96949b37cd23aa71b809e6919724da51fa1e7f0daac49634"}
Oct 30 11:25:44.296789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:44.296404    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"2198c987-319c-4bec-a6b5-2b5fe9378f20","Type":"ContainerStarted","Data":"57772f03efe42b791ff2e6b2f43a9c5517692b1252e0a2ca0257b269fde92e05"}
Oct 30 11:25:44.296789 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:44.296422    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:25:44.342993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:44.342943    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podStartSLOduration=8.342931183 podStartE2EDuration="8.342931183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:25:44.34258233 +0000 UTC m=+2440.688174186" watchObservedRunningTime="2026-10-30 11:25:44.342931183 +0000 UTC m=+2440.688523037"
Oct 30 11:25:51.839200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:51.839164    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:51.872397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:51.872372    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:51.939766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:51.939744    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:51.939852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:51.939839    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:51.956463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:51.956441    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") DevicePath \"csi-5a8f6f191c707df127600b9ba36cc0adfd0e1a7ddd267c6e20416d1bd09523f3\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:52.060840 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:52.060812    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7df80f80ed0e4c658d21d8a82ac94fa2db4558ef72248dc2d4a0162a6c11c695/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:52.088280 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:52.088253    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"data-science-lokistack-compactor-0\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:52.167780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:52.167710    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:52.477167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:52.477144    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:25:52.479809 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:25:52.479781    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dc5795_ce36_4301_a2bd_9d398bc7cf56.slice/crio-8884fb464273daf268a3e067bbb37bc0321cbaefb701127c61816a8c38ea7cb6 WatchSource:0}: Error finding container 8884fb464273daf268a3e067bbb37bc0321cbaefb701127c61816a8c38ea7cb6: Status 404 returned error can't find the container with id 8884fb464273daf268a3e067bbb37bc0321cbaefb701127c61816a8c38ea7cb6
Oct 30 11:25:53.334882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:53.334846    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"00dc5795-ce36-4301-a2bd-9d398bc7cf56","Type":"ContainerStarted","Data":"962a6cf74fb610757bb08464f8c77f83c7b3dbac453bd94d7502c2112dc62f13"}
Oct 30 11:25:53.335370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:53.334898    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"00dc5795-ce36-4301-a2bd-9d398bc7cf56","Type":"ContainerStarted","Data":"8884fb464273daf268a3e067bbb37bc0321cbaefb701127c61816a8c38ea7cb6"}
Oct 30 11:25:53.335370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:53.334944    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:25:53.382063 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:25:53.382023    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" podStartSLOduration=18.382012118 podStartE2EDuration="18.382012118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:25:53.381284023 +0000 UTC m=+2449.726875877" watchObservedRunningTime="2026-10-30 11:25:53.382012118 +0000 UTC m=+2449.727603973"
Oct 30 11:26:01.478848 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:26:01.478816    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:26:04.709330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:04.709295    4488 scope.go:122] "RemoveContainer" containerID="56e981666f7a223d3915db6e4a3ea69bc7ebf3357e16199f4fcce47da5a4cefa"
Oct 30 11:26:04.717358 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:04.717320    4488 scope.go:122] "RemoveContainer" containerID="1a46404a71cd75b84e411d693f3145299e3b09c1d6407167b5ec82b95ee83fc3"
Oct 30 11:26:04.724426 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:04.724409    4488 scope.go:122] "RemoveContainer" containerID="dcebb7fb030260696f4d7e2cb7f9d9cd55c683d6472cd52c14f9fad4cacc9399"
Oct 30 11:26:04.731268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:04.731253    4488 scope.go:122] "RemoveContainer" containerID="49b041b1b3b743f763d2750d598c0ff6d0d8d77edddeae025a85700ae455ed0d"
Oct 30 11:26:04.737665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:04.737641    4488 scope.go:122] "RemoveContainer" containerID="ecf029a695560a566248c0cfa046166ec124b02ad43cad758216d82c1daf69df"
Oct 30 11:26:05.306536 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:05.306501    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:26:14.344435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:14.344404    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:26:15.304985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:15.304942    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:26:18.567700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:18.567617    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:26:18.568143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:18.567802    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" podUID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" containerName="loki-querier" containerID="cri-o://07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a" gracePeriod=30
Oct 30 11:26:19.329367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.329331    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:26:19.441676 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.441647    4488 generic.go:356] "Generic (PLEG): container finished" podID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" containerID="07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a" exitCode=0
Oct 30 11:26:19.441824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.441690    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" event={"ID":"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9","Type":"ContainerDied","Data":"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"}
Oct 30 11:26:19.441824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.441712    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"
Oct 30 11:26:19.441824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.441748    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx" event={"ID":"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9","Type":"ContainerDied","Data":"a9ee68e8f9b1b23b604c1a9b948b40e72c555ae0ae5662840561f3a35d5af5e7"}
Oct 30 11:26:19.441824 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.441768    4488 scope.go:122] "RemoveContainer" containerID="07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"
Oct 30 11:26:19.450000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.449984    4488 scope.go:122] "RemoveContainer" containerID="07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"
Oct 30 11:26:19.450303 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:26:19.450283    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a\": container with ID starting with 07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a not found: ID does not exist" containerID="07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"
Oct 30 11:26:19.450371 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.450312    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a"} err="failed to get container status \"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a\": rpc error: code = NotFound desc = could not find container \"07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a\": container with ID starting with 07ae7bca35981f69c40280c8df59830bdc7e4249381959472a9c7280e4c37d1a not found: ID does not exist"
Oct 30 11:26:19.462712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462691    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.462820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462720    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\" (UniqueName: \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.462820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462752    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.462820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462781    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.462820 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462805    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.463040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.462831    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\") pod \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\" (UID: \"b9ebd321-b1f9-46f2-a7ac-59a8644d94e9\") "
Oct 30 11:26:19.463262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.463230    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:26:19.463397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.463302    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:26:19.465001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.464978    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "kube-api-access-vm4h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:26:19.465084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.464978    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "data-science-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:26:19.465261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.465241    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "test-loki-shared-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:26:19.465261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.465251    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc" pod "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" (UID: "b9ebd321-b1f9-46f2-a7ac-59a8644d94e9"). InnerVolumeSpecName "data-science-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:26:19.563645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563614    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.563777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563649    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm4h6\" (UniqueName: \"kubernetes.io/projected/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-kube-api-access-vm4h6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.563777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563669    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.563777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563686    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-data-science-lokistack-querier-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.563777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563702    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-test-loki-shared-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.563777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.563719    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:26:19.790718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.790689    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:26:19.794640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.794619    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-7bntx"]
Oct 30 11:26:19.803363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:19.803323    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" path="/var/lib/kubelet/pods/b9ebd321-b1f9-46f2-a7ac-59a8644d94e9/volumes"
Oct 30 11:26:25.304620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:26:25.304591    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:26:31.479174 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:26:31.479138    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:27:01.478486 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:27:01.478445    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:27:31.478244 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:27:31.478207    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:28:01.479335 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:01.479297    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:28:16.677835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.677799    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:16.678279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.678244    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" containerName="loki-querier"
Oct 30 11:28:16.678279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.678276    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" containerName="loki-querier"
Oct 30 11:28:16.678524 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.678420    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ebd321-b1f9-46f2-a7ac-59a8644d94e9" containerName="loki-querier"
Oct 30 11:28:16.681712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.681692    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.701549 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.701525    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:16.779831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.779809    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-dockercfg-nvp5k\""
Oct 30 11:28:16.779962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.779882    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-6a6878d3\""
Oct 30 11:28:16.856260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.856235    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.856390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.856283    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.956865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.956802    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.956865 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.956852    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.957485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.957463    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.980965 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.980940    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\") pod \"data-science-usage-logs-collector-5896c48b7-pbvxt\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:16.997170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:16.997112    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:17.291828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.291750    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:17.295525 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:28:17.295487    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60745468_e583_4f5b_8c53_5d4685672352.slice/crio-9db063346d04fb110061f2074840a124573770aa4e9d60783eba43a4597eedce WatchSource:0}: Error finding container 9db063346d04fb110061f2074840a124573770aa4e9d60783eba43a4597eedce: Status 404 returned error can't find the container with id 9db063346d04fb110061f2074840a124573770aa4e9d60783eba43a4597eedce
Oct 30 11:28:17.297630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.297597    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:28:17.297733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.297665    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:28:17.909261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.909229    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" event={"ID":"60745468-e583-4f5b-8c53-5d4685672352","Type":"ContainerStarted","Data":"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"}
Oct 30 11:28:17.909742 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.909277    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" event={"ID":"60745468-e583-4f5b-8c53-5d4685672352","Type":"ContainerStarted","Data":"9db063346d04fb110061f2074840a124573770aa4e9d60783eba43a4597eedce"}
Oct 30 11:28:17.951956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:17.951913    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" podStartSLOduration=1.9519010190000001 podStartE2EDuration="1.951901019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:28:17.951443295 +0000 UTC m=+2594.297035148" watchObservedRunningTime="2026-10-30 11:28:17.951901019 +0000 UTC m=+2594.297492873"
Oct 30 11:28:19.034628 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.034595    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:28:19.035123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.034894    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" podUID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" containerName="loki-compactor" containerID="cri-o://962a6cf74fb610757bb08464f8c77f83c7b3dbac453bd94d7502c2112dc62f13" gracePeriod=30
Oct 30 11:28:19.050810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.050783    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:28:19.050991 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.050957    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester" containerID="cri-o://8d14c745b87edf7b96949b37cd23aa71b809e6919724da51fa1e7f0daac49634" gracePeriod=600
Oct 30 11:28:19.056435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.056412    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:28:19.056618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.056597    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="gateway" containerID="cri-o://079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e" gracePeriod=30
Oct 30 11:28:19.056691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.056616    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="opa" containerID="cri-o://ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c" gracePeriod=30
Oct 30 11:28:19.080211 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.080188    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:28:19.080436 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.080401    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" podUID="68569546-17ad-451a-abbd-252b29111388" containerName="loki-query-frontend" containerID="cri-o://85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807" gracePeriod=30
Oct 30 11:28:19.095800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.095774    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:28:19.096004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.095979    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor" containerID="cri-o://477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f" gracePeriod=30
Oct 30 11:28:19.175703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.175674    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:19.373283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.373259    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:28:19.479532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.479497    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\") pod \"68569546-17ad-451a-abbd-252b29111388\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") "
Oct 30 11:28:19.479687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.479551    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\") pod \"68569546-17ad-451a-abbd-252b29111388\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") "
Oct 30 11:28:19.479687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.479624    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\" (UniqueName: \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\") pod \"68569546-17ad-451a-abbd-252b29111388\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") "
Oct 30 11:28:19.479687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.479653    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\") pod \"68569546-17ad-451a-abbd-252b29111388\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") "
Oct 30 11:28:19.479858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.479696    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\") pod \"68569546-17ad-451a-abbd-252b29111388\" (UID: \"68569546-17ad-451a-abbd-252b29111388\") "
Oct 30 11:28:19.480136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.480112    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config" pod "68569546-17ad-451a-abbd-252b29111388" (UID: "68569546-17ad-451a-abbd-252b29111388"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:19.480260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.480179    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle" pod "68569546-17ad-451a-abbd-252b29111388" (UID: "68569546-17ad-451a-abbd-252b29111388"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:19.481739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.481716    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc" pod "68569546-17ad-451a-abbd-252b29111388" (UID: "68569546-17ad-451a-abbd-252b29111388"). InnerVolumeSpecName "data-science-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:19.481868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.481753    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http" pod "68569546-17ad-451a-abbd-252b29111388" (UID: "68569546-17ad-451a-abbd-252b29111388"). InnerVolumeSpecName "data-science-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:19.481868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.481757    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt" pod "68569546-17ad-451a-abbd-252b29111388" (UID: "68569546-17ad-451a-abbd-252b29111388"). InnerVolumeSpecName "kube-api-access-g2tgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:19.581304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.581279    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:19.581304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.581301    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-query-frontend-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:19.581474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.581312    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2tgt\" (UniqueName: \"kubernetes.io/projected/68569546-17ad-451a-abbd-252b29111388-kube-api-access-g2tgt\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:19.581474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.581320    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:19.581474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.581330    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68569546-17ad-451a-abbd-252b29111388-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:19.920488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.920463    4488 generic.go:356] "Generic (PLEG): container finished" podID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerID="8d14c745b87edf7b96949b37cd23aa71b809e6919724da51fa1e7f0daac49634" exitCode=0
Oct 30 11:28:19.920637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.920534    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"2198c987-319c-4bec-a6b5-2b5fe9378f20","Type":"ContainerDied","Data":"8d14c745b87edf7b96949b37cd23aa71b809e6919724da51fa1e7f0daac49634"}
Oct 30 11:28:19.922656 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.922635    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:28:19.922656 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.922652    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerDied","Data":"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"}
Oct 30 11:28:19.922849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.922636    4488 generic.go:356] "Generic (PLEG): container finished" podID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerID="ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c" exitCode=0
Oct 30 11:28:19.924020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.923999    4488 generic.go:356] "Generic (PLEG): container finished" podID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" containerID="962a6cf74fb610757bb08464f8c77f83c7b3dbac453bd94d7502c2112dc62f13" exitCode=0
Oct 30 11:28:19.924116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.924091    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 11:28:19.924116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.924107    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"00dc5795-ce36-4301-a2bd-9d398bc7cf56","Type":"ContainerDied","Data":"962a6cf74fb610757bb08464f8c77f83c7b3dbac453bd94d7502c2112dc62f13"}
Oct 30 11:28:19.924236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.924156    4488 scope.go:122] "RemoveContainer" containerID="962a6cf74fb610757bb08464f8c77f83c7b3dbac453bd94d7502c2112dc62f13"
Oct 30 11:28:19.925655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.925580    4488 generic.go:356] "Generic (PLEG): container finished" podID="68569546-17ad-451a-abbd-252b29111388" containerID="85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807" exitCode=0
Oct 30 11:28:19.925655 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.925631    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"
Oct 30 11:28:19.925783 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.925663    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" event={"ID":"68569546-17ad-451a-abbd-252b29111388","Type":"ContainerDied","Data":"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"}
Oct 30 11:28:19.925783 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.925706    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj" event={"ID":"68569546-17ad-451a-abbd-252b29111388","Type":"ContainerDied","Data":"00db07de965cd9d4fd685a9f574da35ff43e137926f7afd4287610827d04736d"}
Oct 30 11:28:19.925914 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.925893    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" podUID="60745468-e583-4f5b-8c53-5d4685672352" containerName="otc-container" containerID="cri-o://fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f" gracePeriod=30
Oct 30 11:28:19.941485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:19.935973    4488 scope.go:122] "RemoveContainer" containerID="85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"
Oct 30 11:28:20.006420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.006397    4488 scope.go:122] "RemoveContainer" containerID="85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"
Oct 30 11:28:20.006706 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:20.006684    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807\": container with ID starting with 85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807 not found: ID does not exist" containerID="85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"
Oct 30 11:28:20.006784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.006714    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807"} err="failed to get container status \"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807\": rpc error: code = NotFound desc = could not find container \"85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807\": container with ID starting with 85531b5e3360bee07306caca64acf2fab63065cae9075269d1c91c37c7663807 not found: ID does not exist"
Oct 30 11:28:20.008761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.008740    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:28:20.064874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.064843    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:28:20.069040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.069015    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-rd2qj"]
Oct 30 11:28:20.086817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.086792    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.086865    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.086926    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.086963    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.086990    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.087015    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.087081    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\" (UniqueName: \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\") pod \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\" (UID: \"00dc5795-ce36-4301-a2bd-9d398bc7cf56\") "
Oct 30 11:28:20.087710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.087535    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.087766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.087723    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.089698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.089659    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "data-science-lokistack-compactor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.089807 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.089757    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "data-science-lokistack-compactor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.090084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.090064    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.090218 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.090195    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "pvc-7d33c086-8411-4c5e-bbb7-fd829bece632". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:28:20.090780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.090759    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j" pod "00dc5795-ce36-4301-a2bd-9d398bc7cf56" (UID: "00dc5795-ce36-4301-a2bd-9d398bc7cf56"). InnerVolumeSpecName "kube-api-access-fwg6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.187890 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.187865    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:20.188180 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188154    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188265 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188219    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188263    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188282    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188303    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188321    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188434    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188543 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188499    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") pod \"2198c987-319c-4bec-a6b5-2b5fe9378f20\" (UID: \"2198c987-319c-4bec-a6b5-2b5fe9378f20\") "
Oct 30 11:28:20.188740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188723    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.188829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188744    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.188829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188762    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.188829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188775    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-test-loki-lifecycle-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.188829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188789    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwg6j\" (UniqueName: \"kubernetes.io/projected/00dc5795-ce36-4301-a2bd-9d398bc7cf56-kube-api-access-fwg6j\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.188829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188815    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:28:20.189082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.188829    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/00dc5795-ce36-4301-a2bd-9d398bc7cf56-data-science-lokistack-compactor-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.189137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.189093    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.190538 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.190499    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.190803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.190735    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.191523 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.191501    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "kube-api-access-xkskb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.191826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.191804    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.192621 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.192595    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.193404 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.193367    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:28:20.193943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.193919    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed" pod "2198c987-319c-4bec-a6b5-2b5fe9378f20" (UID: "2198c987-319c-4bec-a6b5-2b5fe9378f20"). InnerVolumeSpecName "pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:28:20.198639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.198623    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-7d33c086-8411-4c5e-bbb7-fd829bece632" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:28:20.275516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.275488    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:28:20.279177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.279153    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 11:28:20.289954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.289934    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\" (UniqueName: \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\") pod \"60745468-e583-4f5b-8c53-5d4685672352\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") "
Oct 30 11:28:20.290091 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.289993    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\") pod \"60745468-e583-4f5b-8c53-5d4685672352\" (UID: \"60745468-e583-4f5b-8c53-5d4685672352\") "
Oct 30 11:28:20.290264 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290247    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290272    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/2198c987-319c-4bec-a6b5-2b5fe9378f20-kube-api-access-xkskb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290291    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-7d33c086-8411-4c5e-bbb7-fd829bece632\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-019deea708189b895\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-5a8f6f191c707df127600b9ba36cc0adfd0e1a7ddd267c6e20416d1bd09523f3\""
Oct 30 11:28:20.290403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290308    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290322    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290304    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal" pod "60745468-e583-4f5b-8c53-5d4685672352" (UID: "60745468-e583-4f5b-8c53-5d4685672352"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.290403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290360    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2198c987-319c-4bec-a6b5-2b5fe9378f20-test-loki-lifecycle-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290403 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290388    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2198c987-319c-4bec-a6b5-2b5fe9378f20-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.290765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290409    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:28:20.290765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.290423    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:28:20.292594 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.292569    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh" pod "60745468-e583-4f5b-8c53-5d4685672352" (UID: "60745468-e583-4f5b-8c53-5d4685672352"). InnerVolumeSpecName "kube-api-access-hl4xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.300098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.300082    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:28:20.303133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.303116    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:28:20.314598 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.314576    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:28:20.391023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.390992    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-8e4fa8c4-18d1-47ba-9c31-d641c06074c2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d2b13fbb21c9894f\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-0693159d8652ea4188320c174c9a37e3576dd66b8db9b87a46af0a124ffc6c0a\""
Oct 30 11:28:20.391023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.391016    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-3ce17b64-6920-453b-9cd0-0f4f1cfc878a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-05e36655afef843ed\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-eb018eb8c11ca00d8d811eb73b56398e204de81e115e3b7ff0d19263934c7c95\""
Oct 30 11:28:20.391023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.391028    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/60745468-e583-4f5b-8c53-5d4685672352-kube-api-access-hl4xh\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.391254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.391039    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/60745468-e583-4f5b-8c53-5d4685672352-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.491856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491773    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.491856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491822    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491880    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491923    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491951    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.491993    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.492018    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.492060    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\") pod \"d0fec47a-6781-494e-bb92-bdad5eac49a9\" (UID: \"d0fec47a-6781-494e-bb92-bdad5eac49a9\") "
Oct 30 11:28:20.492757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.492727    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.494888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.494857    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "data-science-lokistack-gateway-ca-bundle". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.495185 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.495165    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "kube-api-access-l7n8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.495561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.495541    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "tls-secret". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:20.496116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.496084    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "data-science-lokistack-gateway-client-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.497640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.497619    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "lokistack-gateway". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.497717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.497664    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:20.498951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.498933    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants" pod "d0fec47a-6781-494e-bb92-bdad5eac49a9" (UID: "d0fec47a-6781-494e-bb92-bdad5eac49a9"). InnerVolumeSpecName "tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:20.593554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593517    4488 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593547    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-client-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593559    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593569    4488 reconciler_common.go:299] "Volume detached for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-tls-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593578    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7n8c\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-kube-api-access-l7n8c\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593587    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/d0fec47a-6781-494e-bb92-bdad5eac49a9-data-science-lokistack-gateway-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593596    4488 reconciler_common.go:299] "Volume detached for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/d0fec47a-6781-494e-bb92-bdad5eac49a9-lokistack-gateway\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.593784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.593604    4488 reconciler_common.go:299] "Volume detached for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/d0fec47a-6781-494e-bb92-bdad5eac49a9-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:20.931001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.930966    4488 generic.go:356] "Generic (PLEG): container finished" podID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerID="079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e" exitCode=0
Oct 30 11:28:20.931171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.931025    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"
Oct 30 11:28:20.931171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.931050    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerDied","Data":"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"}
Oct 30 11:28:20.931171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.931096    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht" event={"ID":"d0fec47a-6781-494e-bb92-bdad5eac49a9","Type":"ContainerDied","Data":"e4a5a1ec4f03891212e600d7c597b0cd7d9177204e99754ec7ebbe1fe933528f"}
Oct 30 11:28:20.931171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.931120    4488 scope.go:122] "RemoveContainer" containerID="ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"
Oct 30 11:28:20.934692 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.934666    4488 generic.go:356] "Generic (PLEG): container finished" podID="60745468-e583-4f5b-8c53-5d4685672352" containerID="fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f" exitCode=0
Oct 30 11:28:20.934808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.934717    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"
Oct 30 11:28:20.934808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.934747    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" event={"ID":"60745468-e583-4f5b-8c53-5d4685672352","Type":"ContainerDied","Data":"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"}
Oct 30 11:28:20.934808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.934797    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt" event={"ID":"60745468-e583-4f5b-8c53-5d4685672352","Type":"ContainerDied","Data":"9db063346d04fb110061f2074840a124573770aa4e9d60783eba43a4597eedce"}
Oct 30 11:28:20.936190 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.936170    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"2198c987-319c-4bec-a6b5-2b5fe9378f20","Type":"ContainerDied","Data":"57772f03efe42b791ff2e6b2f43a9c5517692b1252e0a2ca0257b269fde92e05"}
Oct 30 11:28:20.936317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.936207    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 11:28:20.940231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.940207    4488 scope.go:122] "RemoveContainer" containerID="079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"
Oct 30 11:28:20.948053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.948037    4488 scope.go:122] "RemoveContainer" containerID="ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"
Oct 30 11:28:20.948317 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:20.948302    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c\": container with ID starting with ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c not found: ID does not exist" containerID="ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"
Oct 30 11:28:20.948397 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.948324    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c"} err="failed to get container status \"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c\": rpc error: code = NotFound desc = could not find container \"ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c\": container with ID starting with ffd10c2baea5fbde7717773801bc6c8b528eef67b9ce699abf8c48283e47c46c not found: ID does not exist"
Oct 30 11:28:20.948788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.948776    4488 scope.go:122] "RemoveContainer" containerID="079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"
Oct 30 11:28:20.949025 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:20.949009    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e\": container with ID starting with 079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e not found: ID does not exist" containerID="079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"
Oct 30 11:28:20.949082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.949028    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e"} err="failed to get container status \"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e\": rpc error: code = NotFound desc = could not find container \"079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e\": container with ID starting with 079726cfeb46abf1f6bdfb8b9367ad4e5ba4dc642a0c762d56a7c2020bf51d7e not found: ID does not exist"
Oct 30 11:28:20.949082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.949042    4488 scope.go:122] "RemoveContainer" containerID="fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"
Oct 30 11:28:20.955730 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.955716    4488 scope.go:122] "RemoveContainer" containerID="fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"
Oct 30 11:28:20.955999 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:20.955978    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f\": container with ID starting with fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f not found: ID does not exist" containerID="fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"
Oct 30 11:28:20.956084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.956004    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f"} err="failed to get container status \"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f\": rpc error: code = NotFound desc = could not find container \"fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f\": container with ID starting with fe5de5152f0ba1e96e818c6d3cad606eec80402feafc5a7a7e3088c7d9e8a99f not found: ID does not exist"
Oct 30 11:28:20.956084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:20.956021    4488 scope.go:122] "RemoveContainer" containerID="8d14c745b87edf7b96949b37cd23aa71b809e6919724da51fa1e7f0daac49634"
Oct 30 11:28:21.001055 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.001035    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:28:21.014180 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.014157    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-698f8cbf65-xvdht"]
Oct 30 11:28:21.056942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.056920    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:21.061074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.061050    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5896c48b7-pbvxt"]
Oct 30 11:28:21.096093 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.096071    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:28:21.102443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.102394    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 11:28:21.803284 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.803254    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" path="/var/lib/kubelet/pods/00dc5795-ce36-4301-a2bd-9d398bc7cf56/volumes"
Oct 30 11:28:21.803665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.803651    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" path="/var/lib/kubelet/pods/2198c987-319c-4bec-a6b5-2b5fe9378f20/volumes"
Oct 30 11:28:21.803959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.803947    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60745468-e583-4f5b-8c53-5d4685672352" path="/var/lib/kubelet/pods/60745468-e583-4f5b-8c53-5d4685672352/volumes"
Oct 30 11:28:21.804573 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.804557    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68569546-17ad-451a-abbd-252b29111388" path="/var/lib/kubelet/pods/68569546-17ad-451a-abbd-252b29111388/volumes"
Oct 30 11:28:21.804921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:21.804903    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" path="/var/lib/kubelet/pods/d0fec47a-6781-494e-bb92-bdad5eac49a9/volumes"
Oct 30 11:28:23.752964 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.752926    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753246    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753261    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753271    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="gateway"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753276    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="gateway"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753285    4488 cpu_manager.go:414] "containerMap: removing container" podUID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" containerName="loki-compactor"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753289    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" containerName="loki-compactor"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753303    4488 cpu_manager.go:414] "containerMap: removing container" podUID="68569546-17ad-451a-abbd-252b29111388" containerName="loki-query-frontend"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753308    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68569546-17ad-451a-abbd-252b29111388" containerName="loki-query-frontend"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753314    4488 cpu_manager.go:414] "containerMap: removing container" podUID="60745468-e583-4f5b-8c53-5d4685672352" containerName="otc-container"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753319    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60745468-e583-4f5b-8c53-5d4685672352" containerName="otc-container"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753329    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="opa"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753333    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="opa"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753419    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2198c987-319c-4bec-a6b5-2b5fe9378f20" containerName="loki-ingester"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753430    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="gateway"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753435    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="00dc5795-ce36-4301-a2bd-9d398bc7cf56" containerName="loki-compactor"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753442    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="68569546-17ad-451a-abbd-252b29111388" containerName="loki-query-frontend"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753448    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="60745468-e583-4f5b-8c53-5d4685672352" containerName="otc-container"
Oct 30 11:28:23.753495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.753455    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0fec47a-6781-494e-bb92-bdad5eac49a9" containerName="opa"
Oct 30 11:28:23.757979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.757959    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.767443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.767418    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:28:23.807415 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.807389    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 11:28:23.807546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.807464    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-grpc\""
Oct 30 11:28:23.807546 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.807490    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-csr95\""
Oct 30 11:28:23.815497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.815481    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-http\""
Oct 30 11:28:23.818213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818189    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.818316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818221    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b5x7\" (UniqueName: \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.818316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818248    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.818465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818310    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.818465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818448    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.818577 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.818540    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.888623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.888595    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:28:23.892484 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.892375    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.913121 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.913097    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:28:23.919597 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919576    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.919714 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919613    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.919714 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919640    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.919805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919720    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9lzw\" (UniqueName: \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.919805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919755    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.919805 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919780    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b5x7\" (UniqueName: \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.919963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919861    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.919963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919901    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.919963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919941    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:23.920111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.919997    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.920111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.920093    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.920561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.920531    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.920976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.920946    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.922272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.922247    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.922495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.922473    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.922599 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.922583    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:23.945507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:23.945480    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b5x7\" (UniqueName: \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\") pod \"data-science-lokistack-querier-56ffbd5fdc-tz5rg\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:24.004733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.004650    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-grpc\""
Oct 30 11:28:24.004733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.004673    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-http\""
Oct 30 11:28:24.020986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.020953    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021014    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021052    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021070    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9lzw\" (UniqueName: \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021100    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021721    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.021856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.021766    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.023402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.023385    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.023508 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.023492    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.044808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.044782    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9lzw\" (UniqueName: \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\") pod \"data-science-lokistack-query-frontend-f746fc66d-g9g2v\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.071638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.071615    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:24.126083 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.126049    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:28:24.132331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.132306    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.153092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153050    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-ca-bundle\""
Oct 30 11:28:24.153213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153099    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 11:28:24.153432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153412    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 11:28:24.153539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153494    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-http\""
Oct 30 11:28:24.153539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153517    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-client-http\""
Oct 30 11:28:24.153669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.153652    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-dockercfg-rttgt\""
Oct 30 11:28:24.155607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.155579    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:28:24.204985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.204954    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.229631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229597    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229636    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4l64\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229657    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229757 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229704    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229807    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229837    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.229901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229871    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.230054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.229940    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.330886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.330852    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331028    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331115 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331074    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331157    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331187    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4l64\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331218    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331327 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331242    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331327 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331282    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.331697 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.331666    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.332038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.332009    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.332144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.332051    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.333572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.333546    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.333760 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.333742    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.334165 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.334147    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.334250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.334233    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.355137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.355113    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4l64\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\") pod \"data-science-lokistack-gateway-b7dfc66f6-rbmq4\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.375296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.375250    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:28:24.377930 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:28:24.377909    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1f0494_2fda_4140_b6d9_b6da53c29667.slice/crio-55d03fb2ac3c679f337878b19dae2c6c9960e0dc4e8441f72624aad1080bf0c9 WatchSource:0}: Error finding container 55d03fb2ac3c679f337878b19dae2c6c9960e0dc4e8441f72624aad1080bf0c9: Status 404 returned error can't find the container with id 55d03fb2ac3c679f337878b19dae2c6c9960e0dc4e8441f72624aad1080bf0c9
Oct 30 11:28:24.466096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.466062    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.513336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.513283    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:28:24.519368 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:28:24.519317    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d8e290_b3c2_4741_8b74_ca357bfa3af8.slice/crio-97f688acba132619ed0684f85820e8e0a5ffa844aa6d7c11ffb213530f97f3ec WatchSource:0}: Error finding container 97f688acba132619ed0684f85820e8e0a5ffa844aa6d7c11ffb213530f97f3ec: Status 404 returned error can't find the container with id 97f688acba132619ed0684f85820e8e0a5ffa844aa6d7c11ffb213530f97f3ec
Oct 30 11:28:24.770949 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.770882    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:28:24.773916 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:28:24.773889    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4dbf332_bc99_4f6f_95c4_c10c1a8873e7.slice/crio-a8b16ab27f438c251e82347831f49ecc1f5d95fdc834f1751229b2af11985f72 WatchSource:0}: Error finding container a8b16ab27f438c251e82347831f49ecc1f5d95fdc834f1751229b2af11985f72: Status 404 returned error can't find the container with id a8b16ab27f438c251e82347831f49ecc1f5d95fdc834f1751229b2af11985f72
Oct 30 11:28:24.956445 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.956393    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" event={"ID":"fa1f0494-2fda-4140-b6d9-b6da53c29667","Type":"ContainerStarted","Data":"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"}
Oct 30 11:28:24.956586 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.956463    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" event={"ID":"fa1f0494-2fda-4140-b6d9-b6da53c29667","Type":"ContainerStarted","Data":"55d03fb2ac3c679f337878b19dae2c6c9960e0dc4e8441f72624aad1080bf0c9"}
Oct 30 11:28:24.956586 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.956492    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:24.958023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.957995    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" event={"ID":"72d8e290-b3c2-4741-8b74-ca357bfa3af8","Type":"ContainerStarted","Data":"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"}
Oct 30 11:28:24.958147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.958045    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:24.958147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.958066    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" event={"ID":"72d8e290-b3c2-4741-8b74-ca357bfa3af8","Type":"ContainerStarted","Data":"97f688acba132619ed0684f85820e8e0a5ffa844aa6d7c11ffb213530f97f3ec"}
Oct 30 11:28:24.959945 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.959923    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerStarted","Data":"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"}
Oct 30 11:28:24.960043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.959960    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerStarted","Data":"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"}
Oct 30 11:28:24.960043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.959978    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerStarted","Data":"a8b16ab27f438c251e82347831f49ecc1f5d95fdc834f1751229b2af11985f72"}
Oct 30 11:28:24.960043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.959994    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.960043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.960009    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.965950 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.965932    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:24.969258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:24.969241    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:28:25.001502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:25.001456    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" podStartSLOduration=2.001440943 podStartE2EDuration="2.001440943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:28:24.9999572 +0000 UTC m=+2601.345549054" watchObservedRunningTime="2026-10-30 11:28:25.001440943 +0000 UTC m=+2601.347032798"
Oct 30 11:28:25.043617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:25.043555    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" podStartSLOduration=2.043544606 podStartE2EDuration="2.043544606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:28:25.043136417 +0000 UTC m=+2601.388728277" watchObservedRunningTime="2026-10-30 11:28:25.043544606 +0000 UTC m=+2601.389136460"
Oct 30 11:28:25.092058 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:25.092021    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" podStartSLOduration=1.092009489 podStartE2EDuration="1.092009489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:28:25.090604974 +0000 UTC m=+2601.436196865" watchObservedRunningTime="2026-10-30 11:28:25.092009489 +0000 UTC m=+2601.437601342"
Oct 30 11:28:26.364259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:26.364218    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:28:31.477923 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:31.477885    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:28:36.364336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:36.364300    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:28:39.832066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.832042    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:28:39.864915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.864866    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\") pod \"192767ba-9495-4897-aa9d-a04a01867585\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") "
Oct 30 11:28:39.864915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.864902    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\" (UniqueName: \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\") pod \"192767ba-9495-4897-aa9d-a04a01867585\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") "
Oct 30 11:28:39.865049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.864931    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\") pod \"192767ba-9495-4897-aa9d-a04a01867585\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") "
Oct 30 11:28:39.865049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.864955    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\") pod \"192767ba-9495-4897-aa9d-a04a01867585\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") "
Oct 30 11:28:39.865159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.865044    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\") pod \"192767ba-9495-4897-aa9d-a04a01867585\" (UID: \"192767ba-9495-4897-aa9d-a04a01867585\") "
Oct 30 11:28:39.865330 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.865297    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle" pod "192767ba-9495-4897-aa9d-a04a01867585" (UID: "192767ba-9495-4897-aa9d-a04a01867585"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:39.865474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.865411    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config" pod "192767ba-9495-4897-aa9d-a04a01867585" (UID: "192767ba-9495-4897-aa9d-a04a01867585"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:28:39.866883 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.866859    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l" pod "192767ba-9495-4897-aa9d-a04a01867585" (UID: "192767ba-9495-4897-aa9d-a04a01867585"). InnerVolumeSpecName "kube-api-access-2m28l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:28:39.867021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.866993    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http" pod "192767ba-9495-4897-aa9d-a04a01867585" (UID: "192767ba-9495-4897-aa9d-a04a01867585"). InnerVolumeSpecName "data-science-lokistack-distributor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:39.867080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.867064    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc" pod "192767ba-9495-4897-aa9d-a04a01867585" (UID: "192767ba-9495-4897-aa9d-a04a01867585"). InnerVolumeSpecName "data-science-lokistack-distributor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:28:39.966432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.966406    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:39.966432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.966429    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m28l\" (UniqueName: \"kubernetes.io/projected/192767ba-9495-4897-aa9d-a04a01867585-kube-api-access-2m28l\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:39.966432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.966439    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:39.966665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.966449    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192767ba-9495-4897-aa9d-a04a01867585-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:39.966665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:39.966458    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/192767ba-9495-4897-aa9d-a04a01867585-data-science-lokistack-distributor-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:28:40.022685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.022655    4488 generic.go:356] "Generic (PLEG): container finished" podID="192767ba-9495-4897-aa9d-a04a01867585" containerID="477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f" exitCode=0
Oct 30 11:28:40.022827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.022707    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"
Oct 30 11:28:40.022827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.022743    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" event={"ID":"192767ba-9495-4897-aa9d-a04a01867585","Type":"ContainerDied","Data":"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"}
Oct 30 11:28:40.022827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.022801    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq" event={"ID":"192767ba-9495-4897-aa9d-a04a01867585","Type":"ContainerDied","Data":"eedc9c5bebedb1cf6a6bf1a95a2e635974e37d8281fc86f8094cd7837ce3ef10"}
Oct 30 11:28:40.022827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.022826    4488 scope.go:122] "RemoveContainer" containerID="477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"
Oct 30 11:28:40.031631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.031613    4488 scope.go:122] "RemoveContainer" containerID="477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"
Oct 30 11:28:40.031904 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:28:40.031883    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f\": container with ID starting with 477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f not found: ID does not exist" containerID="477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"
Oct 30 11:28:40.031952 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.031908    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f"} err="failed to get container status \"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f\": rpc error: code = NotFound desc = could not find container \"477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f\": container with ID starting with 477e2944180a47c2955d16f115738a2f25568f679db4536c0897c4c42038091f not found: ID does not exist"
Oct 30 11:28:40.076159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.076140    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:28:40.081286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:40.081264    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-7qplq"]
Oct 30 11:28:41.802364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:41.802312    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="192767ba-9495-4897-aa9d-a04a01867585" path="/var/lib/kubelet/pods/192767ba-9495-4897-aa9d-a04a01867585/volumes"
Oct 30 11:28:45.968957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:45.968927    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:28:45.969568 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:45.969544    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:28:50.257003 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.256967    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:28:50.257432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.257337    4488 cpu_manager.go:414] "containerMap: removing container" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor"
Oct 30 11:28:50.257432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.257370    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor"
Oct 30 11:28:50.257432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.257428    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="192767ba-9495-4897-aa9d-a04a01867585" containerName="loki-distributor"
Oct 30 11:28:50.261994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.261976    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.292210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.292186    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-grpc\""
Oct 30 11:28:50.292411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.292394    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-http\""
Oct 30 11:28:50.293491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.293472    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:28:50.339455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339426    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87n8\" (UniqueName: \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.339553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339470    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.339553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339494    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.339647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339592    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.339647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339611    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.339647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.339632    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440458    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440495    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440569    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87n8\" (UniqueName: \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440614    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440639    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.440732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.440695    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.441539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.441512    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.441539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.441526    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.443150 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.443117    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.443237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.443119    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.443385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.443369    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:50.464928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:50.464905    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87n8\" (UniqueName: \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.188112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.188078    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.218773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.218745    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.288577 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.288548    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.288701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.288669    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.304041 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.304018    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") DevicePath \"csi-345dd1b68c5259a4fb372bc0cee6cb52c6a7f4e22590ae5065103661275219ed\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.409166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.409142    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/5b6238a2954ef95199bf19d6b2a92fd4c269274ee1250fa34a57dae345cc9d9f/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.434918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.434889    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.573957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.573903    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:56.872260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:56.872183    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:28:56.875675 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:28:56.875646    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25302ec_c2ef_4f60_b3c8_622e75820c54.slice/crio-fa8a3f5ebd72c89d24b65f75184dfa171749a59c43377c7b9317ad28d110f13c WatchSource:0}: Error finding container fa8a3f5ebd72c89d24b65f75184dfa171749a59c43377c7b9317ad28d110f13c: Status 404 returned error can't find the container with id fa8a3f5ebd72c89d24b65f75184dfa171749a59c43377c7b9317ad28d110f13c
Oct 30 11:28:57.099592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:57.099562    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"d25302ec-c2ef-4f60-b3c8-622e75820c54","Type":"ContainerStarted","Data":"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"}
Oct 30 11:28:57.099782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:57.099613    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"d25302ec-c2ef-4f60-b3c8-622e75820c54","Type":"ContainerStarted","Data":"fa8a3f5ebd72c89d24b65f75184dfa171749a59c43377c7b9317ad28d110f13c"}
Oct 30 11:28:57.099782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:57.099665    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:28:57.145675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:28:57.145538    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podStartSLOduration=7.145523373 podStartE2EDuration="7.145523373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:28:57.14478809 +0000 UTC m=+2633.490379969" watchObservedRunningTime="2026-10-30 11:28:57.145523373 +0000 UTC m=+2633.491115229"
Oct 30 11:29:01.477857 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:29:01.477822    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:29:18.109182 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:18.109105    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:29:22.309972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.309938    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:29:22.314932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.314912    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.345241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.345205    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 11:29:22.345409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.345291    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 11:29:22.347457 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.347433    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:29:22.485404 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485380    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.485525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485414    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.485572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485545    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.485610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485575    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5tdb\" (UniqueName: \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.485610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485599    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.485673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.485617    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.586877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.586814    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.586877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.586848    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.586899    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.586992    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5tdb\" (UniqueName: \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.587040    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.587218    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.587646    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.587925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.587906    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.589827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.589798    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.589951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.589932    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.590222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.590206    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:22.610863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:22.610839    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5tdb\" (UniqueName: \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:26.923792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:26.923761    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:26.924252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:26.923805    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:26.954985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:26.954959    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:26.955112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:26.955099    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.024398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.024359    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.024523 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.024456    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.024523 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.024486    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.024595 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.024544    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.040270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.040248    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") DevicePath \"csi-d17a5cfde09b14926981247cc68de0131f1093d8751a39849c3b87670b64266d\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.040383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.040249    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") DevicePath \"csi-fd32f1d9e505c328e913c292bbfa44a420827ab32b7051f414bb8baa23b45671\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.143478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.143453    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/186c84c83760be5837750810e291c0bfee785cbd5ee4b0582f60daafa9018035/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.150741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.150718    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/0d90e1e43de51125033a7f82cd0645765bf678ea2057dc8845fad0d0b4c35b0f/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.173868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.173819    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.175206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.175189    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"data-science-lokistack-ingester-1\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.426935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.426872    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:27.739734 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:27.739665    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:29:27.743038 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:29:27.743012    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cf7a84_7e0b_4c04_8b51_944454cd587c.slice/crio-36389a9e159528e3a54c94b529e9778d4a71283d311623f3d3ab71638e15acca WatchSource:0}: Error finding container 36389a9e159528e3a54c94b529e9778d4a71283d311623f3d3ab71638e15acca: Status 404 returned error can't find the container with id 36389a9e159528e3a54c94b529e9778d4a71283d311623f3d3ab71638e15acca
Oct 30 11:29:28.223802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:28.223772    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"d4cf7a84-7e0b-4c04-8b51-944454cd587c","Type":"ContainerStarted","Data":"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"}
Oct 30 11:29:28.224141 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:28.223817    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"d4cf7a84-7e0b-4c04-8b51-944454cd587c","Type":"ContainerStarted","Data":"36389a9e159528e3a54c94b529e9778d4a71283d311623f3d3ab71638e15acca"}
Oct 30 11:29:28.224141 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:28.223903    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:29:28.269473 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:28.269419    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podStartSLOduration=6.269405817 podStartE2EDuration="6.269405817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:29:28.268832259 +0000 UTC m=+2664.614424112" watchObservedRunningTime="2026-10-30 11:29:28.269405817 +0000 UTC m=+2664.614997671"
Oct 30 11:29:31.478081 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:29:31.478047    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:29:49.233132 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:49.233097    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:29:59.231672 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:29:59.231634    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:30:01.477855 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:30:01.477818    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:30:09.231642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:30:09.231607    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:30:31.478568 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:30:31.478529    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:31:01.477904 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:01.477869    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:31:31.478399 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:31.478357    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:31:32.510938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.510906    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:32.514440 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.514418    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.525579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.525556    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td69s\" (UniqueName: \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.525691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.525595    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.533645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.533617    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:32.606064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.606043    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-dockercfg-zzjcl\""
Oct 30 11:31:32.609796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.609781    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-6a6878d3\""
Oct 30 11:31:32.626196 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.626175    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td69s\" (UniqueName: \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.626286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.626204    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.626922 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.626900    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.650971 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.650937    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td69s\" (UniqueName: \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\") pod \"data-science-usage-logs-collector-5964dd49df-cthk5\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:32.826962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:32.826885    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:33.122552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.122477    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:33.125779 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:31:33.125752    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdaf4bb9_93f7_4170_9220_e59a48740a95.slice/crio-739fd9ac116b6b7693c7486076fb1d3684d3e2d1cc0b5b08fb4cb73f701b4206 WatchSource:0}: Error finding container 739fd9ac116b6b7693c7486076fb1d3684d3e2d1cc0b5b08fb4cb73f701b4206: Status 404 returned error can't find the container with id 739fd9ac116b6b7693c7486076fb1d3684d3e2d1cc0b5b08fb4cb73f701b4206
Oct 30 11:31:33.128109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.128071    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:31:33.128169 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.128151    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:31:33.729975 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.729933    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" event={"ID":"cdaf4bb9-93f7-4170-9220-e59a48740a95","Type":"ContainerStarted","Data":"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"}
Oct 30 11:31:33.730383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.730004    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" event={"ID":"cdaf4bb9-93f7-4170-9220-e59a48740a95","Type":"ContainerStarted","Data":"739fd9ac116b6b7693c7486076fb1d3684d3e2d1cc0b5b08fb4cb73f701b4206"}
Oct 30 11:31:33.778918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:33.778873    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" podStartSLOduration=1.778861081 podStartE2EDuration="1.778861081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:31:33.777582355 +0000 UTC m=+2790.123174204" watchObservedRunningTime="2026-10-30 11:31:33.778861081 +0000 UTC m=+2790.124452934"
Oct 30 11:31:34.791023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.790989    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:31:34.791658 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.791203    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester" containerID="cri-o://05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8" gracePeriod=600
Oct 30 11:31:34.838452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.838418    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:31:34.838648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.838626    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podUID="d25302ec-c2ef-4f60-b3c8-622e75820c54" containerName="loki-index-gateway" containerID="cri-o://9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e" gracePeriod=30
Oct 30 11:31:34.864118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.864092    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:31:34.864396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.864322    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="gateway" containerID="cri-o://59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c" gracePeriod=30
Oct 30 11:31:34.864396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.864379    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="opa" containerID="cri-o://3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb" gracePeriod=30
Oct 30 11:31:34.879266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.879239    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:31:34.879537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.879459    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" podUID="fa1f0494-2fda-4140-b6d9-b6da53c29667" containerName="loki-querier" containerID="cri-o://ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb" gracePeriod=30
Oct 30 11:31:34.884303 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.884277    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:31:34.884896 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.884513    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" podUID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" containerName="loki-query-frontend" containerID="cri-o://e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf" gracePeriod=30
Oct 30 11:31:34.960706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.960666    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="opa" probeResult="failure" output="Get \"https://10.133.0.161:8083/ready\": dial tcp 10.133.0.161:8083: connect: connection refused"
Oct 30 11:31:34.965836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.965809    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:34.967954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:34.967913    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="gateway" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 11:31:35.225290 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.225261    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:31:35.228412 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.228388    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:31:35.245857 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.245832    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.245994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.245886    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\" (UniqueName: \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.245994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.245915    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\") pod \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") "
Oct 30 11:31:35.245994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.245957    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.245994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.245987    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.246213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246042    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\") pod \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") "
Oct 30 11:31:35.246213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246075    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.246213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246108    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\") pod \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") "
Oct 30 11:31:35.246213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246144    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.246213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246203    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\") pod \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") "
Oct 30 11:31:35.246562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246272    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\" (UniqueName: \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\") pod \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\" (UID: \"72d8e290-b3c2-4741-8b74-ca357bfa3af8\") "
Oct 30 11:31:35.246562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.246302    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\") pod \"d25302ec-c2ef-4f60-b3c8-622e75820c54\" (UID: \"d25302ec-c2ef-4f60-b3c8-622e75820c54\") "
Oct 30 11:31:35.247565 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.247290    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.248079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.247805    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.248705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.248310    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle" pod "72d8e290-b3c2-4741-8b74-ca357bfa3af8" (UID: "72d8e290-b3c2-4741-8b74-ca357bfa3af8"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.248705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.248641    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config" pod "72d8e290-b3c2-4741-8b74-ca357bfa3af8" (UID: "72d8e290-b3c2-4741-8b74-ca357bfa3af8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.249663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.249636    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc" pod "72d8e290-b3c2-4741-8b74-ca357bfa3af8" (UID: "72d8e290-b3c2-4741-8b74-ca357bfa3af8"). InnerVolumeSpecName "data-science-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.250600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250572    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.250758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250701    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http" pod "72d8e290-b3c2-4741-8b74-ca357bfa3af8" (UID: "72d8e290-b3c2-4741-8b74-ca357bfa3af8"). InnerVolumeSpecName "data-science-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250831    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw" pod "72d8e290-b3c2-4741-8b74-ca357bfa3af8" (UID: "72d8e290-b3c2-4741-8b74-ca357bfa3af8"). InnerVolumeSpecName "kube-api-access-n9lzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:35.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250875    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "data-science-lokistack-index-gateway-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250918    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:31:35.250940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.250923    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "kube-api-access-r87n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:35.251592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.251570    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc" pod "d25302ec-c2ef-4f60-b3c8-622e75820c54" (UID: "d25302ec-c2ef-4f60-b3c8-622e75820c54"). InnerVolumeSpecName "data-science-lokistack-index-gateway-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.340255 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.340229    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:31:35.347000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.346983    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347038    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347086    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347150    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\" (UniqueName: \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347213 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347179    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347230    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\") pod \"fa1f0494-2fda-4140-b6d9-b6da53c29667\" (UID: \"fa1f0494-2fda-4140-b6d9-b6da53c29667\") "
Oct 30 11:31:35.347521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347494    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347562    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r87n8\" (UniqueName: \"kubernetes.io/projected/d25302ec-c2ef-4f60-b3c8-622e75820c54-kube-api-access-r87n8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347576    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347586    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-test-loki-lifecycle-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347595    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347598    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.347641 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347607    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347655    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347675    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-query-frontend-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347691    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347706    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d8e290-b3c2-4741-8b74-ca357bfa3af8-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347721    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9lzw\" (UniqueName: \"kubernetes.io/projected/72d8e290-b3c2-4741-8b74-ca357bfa3af8-kube-api-access-n9lzw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347737    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/d25302ec-c2ef-4f60-b3c8-622e75820c54-data-science-lokistack-index-gateway-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.347968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.347785    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:31:35.349422 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.349387    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.349503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.349401    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "data-science-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.349711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.349682    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "data-science-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.349711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.349696    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7" pod "fa1f0494-2fda-4140-b6d9-b6da53c29667" (UID: "fa1f0494-2fda-4140-b6d9-b6da53c29667"). InnerVolumeSpecName "kube-api-access-8b5x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:35.356800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.356784    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448515    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448591    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-test-loki-lifecycle-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448613    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b5x7\" (UniqueName: \"kubernetes.io/projected/fa1f0494-2fda-4140-b6d9-b6da53c29667-kube-api-access-8b5x7\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448632    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448656    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1f0494-2fda-4140-b6d9-b6da53c29667-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448672    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-8dfd52e7-ed74-4fe2-b5b1-118c5d7c74a9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c1499c5fb7eaf015\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-345dd1b68c5259a4fb372bc0cee6cb52c6a7f4e22590ae5065103661275219ed\""
Oct 30 11:31:35.453816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.448691    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fa1f0494-2fda-4140-b6d9-b6da53c29667-data-science-lokistack-querier-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.722724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.722698    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:31:35.740658 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.740632    4488 generic.go:356] "Generic (PLEG): container finished" podID="fa1f0494-2fda-4140-b6d9-b6da53c29667" containerID="ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb" exitCode=0
Oct 30 11:31:35.740817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.740694    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"
Oct 30 11:31:35.740817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.740716    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" event={"ID":"fa1f0494-2fda-4140-b6d9-b6da53c29667","Type":"ContainerDied","Data":"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"}
Oct 30 11:31:35.740817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.740803    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg" event={"ID":"fa1f0494-2fda-4140-b6d9-b6da53c29667","Type":"ContainerDied","Data":"55d03fb2ac3c679f337878b19dae2c6c9960e0dc4e8441f72624aad1080bf0c9"}
Oct 30 11:31:35.740977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.740831    4488 scope.go:122] "RemoveContainer" containerID="ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"
Oct 30 11:31:35.742270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.742247    4488 generic.go:356] "Generic (PLEG): container finished" podID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" containerID="e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf" exitCode=0
Oct 30 11:31:35.742472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.742309    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"
Oct 30 11:31:35.742472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.742335    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" event={"ID":"72d8e290-b3c2-4741-8b74-ca357bfa3af8","Type":"ContainerDied","Data":"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"}
Oct 30 11:31:35.742472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.742402    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v" event={"ID":"72d8e290-b3c2-4741-8b74-ca357bfa3af8","Type":"ContainerDied","Data":"97f688acba132619ed0684f85820e8e0a5ffa844aa6d7c11ffb213530f97f3ec"}
Oct 30 11:31:35.744648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.744624    4488 generic.go:356] "Generic (PLEG): container finished" podID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerID="3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb" exitCode=0
Oct 30 11:31:35.744766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.744698    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerDied","Data":"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"}
Oct 30 11:31:35.746431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.746247    4488 generic.go:356] "Generic (PLEG): container finished" podID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerID="05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8" exitCode=0
Oct 30 11:31:35.746431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.746295    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 11:31:35.746431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.746367    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"d4cf7a84-7e0b-4c04-8b51-944454cd587c","Type":"ContainerDied","Data":"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"}
Oct 30 11:31:35.746431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.746405    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"d4cf7a84-7e0b-4c04-8b51-944454cd587c","Type":"ContainerDied","Data":"36389a9e159528e3a54c94b529e9778d4a71283d311623f3d3ab71638e15acca"}
Oct 30 11:31:35.747867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.747840    4488 generic.go:356] "Generic (PLEG): container finished" podID="d25302ec-c2ef-4f60-b3c8-622e75820c54" containerID="9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e" exitCode=0
Oct 30 11:31:35.747977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.747899    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 11:31:35.747977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.747908    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"d25302ec-c2ef-4f60-b3c8-622e75820c54","Type":"ContainerDied","Data":"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"}
Oct 30 11:31:35.747977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.747943    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"d25302ec-c2ef-4f60-b3c8-622e75820c54","Type":"ContainerDied","Data":"fa8a3f5ebd72c89d24b65f75184dfa171749a59c43377c7b9317ad28d110f13c"}
Oct 30 11:31:35.748410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.748390    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" podUID="cdaf4bb9-93f7-4170-9220-e59a48740a95" containerName="otc-container" containerID="cri-o://b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9" gracePeriod=30
Oct 30 11:31:35.751068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.751044    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.752171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752150    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752218    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\" (UniqueName: \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752277    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752303    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752374    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752408    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.752490    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") pod \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\" (UID: \"d4cf7a84-7e0b-4c04-8b51-944454cd587c\") "
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.753140    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.753908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.753799    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:35.756507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756481    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "kube-api-access-g5tdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:35.756507 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756484    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.756699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756660    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.756699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756685    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "pvc-5016d491-1af7-4119-a668-95a1697a696b". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:31:35.756699 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756698    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:31:35.756935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756772    4488 scope.go:122] "RemoveContainer" containerID="ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"
Oct 30 11:31:35.756935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.756900    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret" pod "d4cf7a84-7e0b-4c04-8b51-944454cd587c" (UID: "d4cf7a84-7e0b-4c04-8b51-944454cd587c"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:35.757142 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:35.757121    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb\": container with ID starting with ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb not found: ID does not exist" containerID="ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"
Oct 30 11:31:35.757209 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.757149    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb"} err="failed to get container status \"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb\": rpc error: code = NotFound desc = could not find container \"ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb\": container with ID starting with ab754a5b07c10f7504411c928dba9dfdfaf9219f2dea94a7656743d525d7baeb not found: ID does not exist"
Oct 30 11:31:35.757209 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.757166    4488 scope.go:122] "RemoveContainer" containerID="e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"
Oct 30 11:31:35.766291 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.766274    4488 scope.go:122] "RemoveContainer" containerID="e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"
Oct 30 11:31:35.766603 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:35.766580    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf\": container with ID starting with e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf not found: ID does not exist" containerID="e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"
Oct 30 11:31:35.766686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.766612    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf"} err="failed to get container status \"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf\": rpc error: code = NotFound desc = could not find container \"e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf\": container with ID starting with e35550ac04918fb20e74ee5065cfe195ceb53acb946b596606889fcc9449a1cf not found: ID does not exist"
Oct 30 11:31:35.766686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.766635    4488 scope.go:122] "RemoveContainer" containerID="05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"
Oct 30 11:31:35.810287 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.810265    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:31:35.812973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.812952    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-g9g2v"]
Oct 30 11:31:35.853114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853093    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5tdb\" (UniqueName: \"kubernetes.io/projected/d4cf7a84-7e0b-4c04-8b51-944454cd587c-kube-api-access-g5tdb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853116    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853133    4488 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-test-loki-lifecycle-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853146    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853160    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853196    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853211    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/d4cf7a84-7e0b-4c04-8b51-944454cd587c-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:35.853231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.853232    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:31:35.864184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.864167    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-5016d491-1af7-4119-a668-95a1697a696b" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:31:35.864716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.864674    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:31:35.867739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.867724    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:31:35.871064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.870850    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-tz5rg"]
Oct 30 11:31:35.885915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.885892    4488 scope.go:122] "RemoveContainer" containerID="05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"
Oct 30 11:31:35.886254 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:35.886235    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8\": container with ID starting with 05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8 not found: ID does not exist" containerID="05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"
Oct 30 11:31:35.886329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.886265    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8"} err="failed to get container status \"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8\": rpc error: code = NotFound desc = could not find container \"05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8\": container with ID starting with 05e2ded9e90acbe6854f81044707bced4dc7e93ec27da804ca6e41f7378ef2a8 not found: ID does not exist"
Oct 30 11:31:35.886329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.886282    4488 scope.go:122] "RemoveContainer" containerID="9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"
Oct 30 11:31:35.895818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.895796    4488 scope.go:122] "RemoveContainer" containerID="9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"
Oct 30 11:31:35.896104 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:35.896083    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e\": container with ID starting with 9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e not found: ID does not exist" containerID="9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"
Oct 30 11:31:35.896184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.896110    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e"} err="failed to get container status \"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e\": rpc error: code = NotFound desc = could not find container \"9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e\": container with ID starting with 9c6301e01495f27dad64668c011c2c6802c25f24d12fc3af2dd77b8db5e1d10e not found: ID does not exist"
Oct 30 11:31:35.905713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.905688    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:31:35.911155 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.911130    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 11:31:35.953629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.953606    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-5016d491-1af7-4119-a668-95a1697a696b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00202e19da6748af3\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-d17a5cfde09b14926981247cc68de0131f1093d8751a39849c3b87670b64266d\""
Oct 30 11:31:35.953718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:35.953632    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-6dcdb7ad-d1ff-4871-aad9-1c2bebcc5bb8\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00cd6a945cbbaf973\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-fd32f1d9e505c328e913c292bbfa44a420827ab32b7051f414bb8baa23b45671\""
Oct 30 11:31:36.012159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.012135    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:36.053872 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.053840    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\" (UniqueName: \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\") pod \"cdaf4bb9-93f7-4170-9220-e59a48740a95\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") "
Oct 30 11:31:36.054015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.053997    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\" (UniqueName: \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\") pod \"cdaf4bb9-93f7-4170-9220-e59a48740a95\" (UID: \"cdaf4bb9-93f7-4170-9220-e59a48740a95\") "
Oct 30 11:31:36.054166 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.054146    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal" pod "cdaf4bb9-93f7-4170-9220-e59a48740a95" (UID: "cdaf4bb9-93f7-4170-9220-e59a48740a95"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:36.059396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.057589    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s" pod "cdaf4bb9-93f7-4170-9220-e59a48740a95" (UID: "cdaf4bb9-93f7-4170-9220-e59a48740a95"). InnerVolumeSpecName "kube-api-access-td69s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:36.096107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.096076    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:31:36.099229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.099204    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 11:31:36.104515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.104495    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:31:36.154843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.154784    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.154843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.154825    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.154849    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.154911    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.154978    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155021 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155006    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155031    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155087    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\") pod \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\" (UID: \"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7\") "
Oct 30 11:31:36.155336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155317    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td69s\" (UniqueName: \"kubernetes.io/projected/cdaf4bb9-93f7-4170-9220-e59a48740a95-kube-api-access-td69s\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.155408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155358    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cdaf4bb9-93f7-4170-9220-e59a48740a95-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.155945 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.155920    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:36.158222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.158197    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "data-science-lokistack-gateway-ca-bundle". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:36.158369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.158254    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "kube-api-access-k4l64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:36.158573 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.158540    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "tls-secret". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:31:36.159814 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.159793    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "data-science-lokistack-gateway-client-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:36.160768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.160746    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "lokistack-gateway". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:36.161034 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.161011    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:31:36.162415 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.162396    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants" pod "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" (UID: "a4dbf332-bc99-4f6f-95c4-c10c1a8873e7"). InnerVolumeSpecName "tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:31:36.255931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255905    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.255931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255930    4488 reconciler_common.go:299] "Volume detached for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tls-secret\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255943    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4l64\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-kube-api-access-k4l64\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255956    4488 reconciler_common.go:299] "Volume detached for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-lokistack-gateway\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255967    4488 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-rbac\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255979    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-ca-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.255993    4488 reconciler_common.go:299] "Volume detached for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-tenants\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.256092 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.256005    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7-data-science-lokistack-gateway-client-http\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:31:36.508170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.508137    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:31:36.510520 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.510488    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 11:31:36.548956 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.548930    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:31:36.549117 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.549094    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="dca290d4-4612-4776-95eb-f72362336404" containerName="seaweedfs" containerID="cri-o://da9a6cf3f2991ef0b210c47b61c3d86dc7c12d7795aed29ab99918b2a199cc02" gracePeriod=30
Oct 30 11:31:36.755363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.755316    4488 generic.go:356] "Generic (PLEG): container finished" podID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerID="59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c" exitCode=0
Oct 30 11:31:36.755481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.755371    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerDied","Data":"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"}
Oct 30 11:31:36.755481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.755418    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4" event={"ID":"a4dbf332-bc99-4f6f-95c4-c10c1a8873e7","Type":"ContainerDied","Data":"a8b16ab27f438c251e82347831f49ecc1f5d95fdc834f1751229b2af11985f72"}
Oct 30 11:31:36.755481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.755439    4488 scope.go:122] "RemoveContainer" containerID="3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"
Oct 30 11:31:36.755481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.755381    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"
Oct 30 11:31:36.761087 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.761060    4488 generic.go:356] "Generic (PLEG): container finished" podID="cdaf4bb9-93f7-4170-9220-e59a48740a95" containerID="b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9" exitCode=0
Oct 30 11:31:36.761218 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.761106    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"
Oct 30 11:31:36.761218 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.761094    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" event={"ID":"cdaf4bb9-93f7-4170-9220-e59a48740a95","Type":"ContainerDied","Data":"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"}
Oct 30 11:31:36.761313 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.761245    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5" event={"ID":"cdaf4bb9-93f7-4170-9220-e59a48740a95","Type":"ContainerDied","Data":"739fd9ac116b6b7693c7486076fb1d3684d3e2d1cc0b5b08fb4cb73f701b4206"}
Oct 30 11:31:36.766910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.766893    4488 scope.go:122] "RemoveContainer" containerID="59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"
Oct 30 11:31:36.775184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.775169    4488 scope.go:122] "RemoveContainer" containerID="3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"
Oct 30 11:31:36.775431 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:36.775413    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb\": container with ID starting with 3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb not found: ID does not exist" containerID="3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"
Oct 30 11:31:36.775489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.775438    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb"} err="failed to get container status \"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb\": rpc error: code = NotFound desc = could not find container \"3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb\": container with ID starting with 3c15aa5010985406c5b7ebfef29d01238745232c7de9f4a4ae9c1c836e4bbfcb not found: ID does not exist"
Oct 30 11:31:36.775489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.775457    4488 scope.go:122] "RemoveContainer" containerID="59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"
Oct 30 11:31:36.775682 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:36.775667    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c\": container with ID starting with 59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c not found: ID does not exist" containerID="59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"
Oct 30 11:31:36.775724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.775687    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c"} err="failed to get container status \"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c\": rpc error: code = NotFound desc = could not find container \"59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c\": container with ID starting with 59d87bdabaf79852dded50b60d3ff049a864bb54a8d5d05fea2204408e88242c not found: ID does not exist"
Oct 30 11:31:36.775724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.775701    4488 scope.go:122] "RemoveContainer" containerID="b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"
Oct 30 11:31:36.782509 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.782491    4488 scope.go:122] "RemoveContainer" containerID="b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"
Oct 30 11:31:36.782765 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:31:36.782745    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9\": container with ID starting with b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9 not found: ID does not exist" containerID="b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"
Oct 30 11:31:36.782812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.782771    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9"} err="failed to get container status \"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9\": rpc error: code = NotFound desc = could not find container \"b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9\": container with ID starting with b085894e612a5c96636f56b3ae7c16b46d6b085effb11c8fd5d605d76b3553e9 not found: ID does not exist"
Oct 30 11:31:36.809733 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.809711    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:31:36.822776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.822753    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-b7dfc66f6-rbmq4"]
Oct 30 11:31:36.859766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.859742    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:36.865815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:36.865795    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5964dd49df-cthk5"]
Oct 30 11:31:37.801336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.801293    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" path="/var/lib/kubelet/pods/72d8e290-b3c2-4741-8b74-ca357bfa3af8/volumes"
Oct 30 11:31:37.801773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.801751    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" path="/var/lib/kubelet/pods/a4dbf332-bc99-4f6f-95c4-c10c1a8873e7/volumes"
Oct 30 11:31:37.802145 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.802125    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfb7faf1-edb1-42d7-af3e-5567df9195fd" path="/var/lib/kubelet/pods/bfb7faf1-edb1-42d7-af3e-5567df9195fd/volumes"
Oct 30 11:31:37.802822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.802800    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cdaf4bb9-93f7-4170-9220-e59a48740a95" path="/var/lib/kubelet/pods/cdaf4bb9-93f7-4170-9220-e59a48740a95/volumes"
Oct 30 11:31:37.803240 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.803221    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d25302ec-c2ef-4f60-b3c8-622e75820c54" path="/var/lib/kubelet/pods/d25302ec-c2ef-4f60-b3c8-622e75820c54/volumes"
Oct 30 11:31:37.803660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.803642    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" path="/var/lib/kubelet/pods/d4cf7a84-7e0b-4c04-8b51-944454cd587c/volumes"
Oct 30 11:31:37.804301 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:31:37.804281    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa1f0494-2fda-4140-b6d9-b6da53c29667" path="/var/lib/kubelet/pods/fa1f0494-2fda-4140-b6d9-b6da53c29667/volumes"
Oct 30 11:32:01.478135 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:01.478100    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:32:01.860994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.860961    4488 generic.go:356] "Generic (PLEG): container finished" podID="dca290d4-4612-4776-95eb-f72362336404" containerID="da9a6cf3f2991ef0b210c47b61c3d86dc7c12d7795aed29ab99918b2a199cc02" exitCode=0
Oct 30 11:32:01.861171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.861039    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"dca290d4-4612-4776-95eb-f72362336404","Type":"ContainerDied","Data":"da9a6cf3f2991ef0b210c47b61c3d86dc7c12d7795aed29ab99918b2a199cc02"}
Oct 30 11:32:01.896198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.896169    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:32:01.931382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.931352    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\" (UniqueName: \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\") pod \"dca290d4-4612-4776-95eb-f72362336404\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") "
Oct 30 11:32:01.931528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.931421    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\" (UniqueName: \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\") pod \"dca290d4-4612-4776-95eb-f72362336404\" (UID: \"dca290d4-4612-4776-95eb-f72362336404\") "
Oct 30 11:32:01.932488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.932461    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data" pod "dca290d4-4612-4776-95eb-f72362336404" (UID: "dca290d4-4612-4776-95eb-f72362336404"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:32:01.933476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:01.933450    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr" pod "dca290d4-4612-4776-95eb-f72362336404" (UID: "dca290d4-4612-4776-95eb-f72362336404"). InnerVolumeSpecName "kube-api-access-jtrmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:32:02.032319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.032243    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtrmr\" (UniqueName: \"kubernetes.io/projected/dca290d4-4612-4776-95eb-f72362336404-kube-api-access-jtrmr\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:02.032319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.032270    4488 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dca290d4-4612-4776-95eb-f72362336404-data\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:02.866123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.866098    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 11:32:02.866649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.866096    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"dca290d4-4612-4776-95eb-f72362336404","Type":"ContainerDied","Data":"9b147a40ad8a7eedae2f338d6b00750ad6979b6d13ebd096e178a8cad42446c3"}
Oct 30 11:32:02.866649 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.866217    4488 scope.go:122] "RemoveContainer" containerID="da9a6cf3f2991ef0b210c47b61c3d86dc7c12d7795aed29ab99918b2a199cc02"
Oct 30 11:32:02.918861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.918838    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:32:02.924821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:02.924802    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 11:32:03.801940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:03.801909    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dca290d4-4612-4776-95eb-f72362336404" path="/var/lib/kubelet/pods/dca290d4-4612-4776-95eb-f72362336404/volumes"
Oct 30 11:32:04.825177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:04.825140    4488 scope.go:122] "RemoveContainer" containerID="2af997686404401745abd0405c7d75a65485fe8413bf6424faa344a96560d14c"
Oct 30 11:32:08.076488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076455    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:08.076948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076892    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="opa"
Oct 30 11:32:08.076948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076910    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="opa"
Oct 30 11:32:08.076948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076922    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d25302ec-c2ef-4f60-b3c8-622e75820c54" containerName="loki-index-gateway"
Oct 30 11:32:08.076948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076931    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d25302ec-c2ef-4f60-b3c8-622e75820c54" containerName="loki-index-gateway"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076950    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="gateway"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076959    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="gateway"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076974    4488 cpu_manager.go:414] "containerMap: removing container" podUID="dca290d4-4612-4776-95eb-f72362336404" containerName="seaweedfs"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076982    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dca290d4-4612-4776-95eb-f72362336404" containerName="seaweedfs"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.076999    4488 cpu_manager.go:414] "containerMap: removing container" podUID="fa1f0494-2fda-4140-b6d9-b6da53c29667" containerName="loki-querier"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077006    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa1f0494-2fda-4140-b6d9-b6da53c29667" containerName="loki-querier"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077020    4488 cpu_manager.go:414] "containerMap: removing container" podUID="cdaf4bb9-93f7-4170-9220-e59a48740a95" containerName="otc-container"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077027    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cdaf4bb9-93f7-4170-9220-e59a48740a95" containerName="otc-container"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077051    4488 cpu_manager.go:414] "containerMap: removing container" podUID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" containerName="loki-query-frontend"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077058    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" containerName="loki-query-frontend"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077071    4488 cpu_manager.go:414] "containerMap: removing container" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester"
Oct 30 11:32:08.077094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077078    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077148    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="gateway"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077158    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="dca290d4-4612-4776-95eb-f72362336404" containerName="seaweedfs"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077167    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa1f0494-2fda-4140-b6d9-b6da53c29667" containerName="loki-querier"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077176    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="cdaf4bb9-93f7-4170-9220-e59a48740a95" containerName="otc-container"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077187    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="72d8e290-b3c2-4741-8b74-ca357bfa3af8" containerName="loki-query-frontend"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077198    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4cf7a84-7e0b-4c04-8b51-944454cd587c" containerName="loki-ingester"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077209    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4dbf332-bc99-4f6f-95c4-c10c1a8873e7" containerName="opa"
Oct 30 11:32:08.077478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.077216    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="d25302ec-c2ef-4f60-b3c8-622e75820c54" containerName="loki-index-gateway"
Oct 30 11:32:08.089363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.089318    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:08.097073 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.097048    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:08.108638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.108615    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:32:08.108752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.108687    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:32:08.108794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.108748    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:32:08.185247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.185220    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmjz\" (UniqueName: \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r\" (UID: \"554db2b8-30a8-4ba4-84f5-14222c331665\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:08.286242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.286211    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmjz\" (UniqueName: \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r\" (UID: \"554db2b8-30a8-4ba4-84f5-14222c331665\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:08.310393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.310359    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmjz\" (UniqueName: \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r\" (UID: \"554db2b8-30a8-4ba4-84f5-14222c331665\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:08.402119 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.402062    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:08.697402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.697371    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:08.701001 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:08.700975    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod554db2b8_30a8_4ba4_84f5_14222c331665.slice/crio-f439ab37ab6b10104fdd7478773f8cd8777a59033076349a0cb96d12c5d217e8 WatchSource:0}: Error finding container f439ab37ab6b10104fdd7478773f8cd8777a59033076349a0cb96d12c5d217e8: Status 404 returned error can't find the container with id f439ab37ab6b10104fdd7478773f8cd8777a59033076349a0cb96d12c5d217e8
Oct 30 11:32:08.888477 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.888445    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" event={"ID":"554db2b8-30a8-4ba4-84f5-14222c331665","Type":"ContainerStarted","Data":"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"}
Oct 30 11:32:08.888635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.888487    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" event={"ID":"554db2b8-30a8-4ba4-84f5-14222c331665","Type":"ContainerStarted","Data":"f439ab37ab6b10104fdd7478773f8cd8777a59033076349a0cb96d12c5d217e8"}
Oct 30 11:32:08.930913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:08.930867    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" podStartSLOduration=0.930854167 podStartE2EDuration="930.854167ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:08.929802256 +0000 UTC m=+2825.275394110" watchObservedRunningTime="2026-10-30 11:32:08.930854167 +0000 UTC m=+2825.276446020"
Oct 30 11:32:09.144075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.143992    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:09.147097 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.147076    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.153123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.153081    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:32:09.156317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.156299    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.165261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.165240    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:32:09.169823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.169795    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:09.175867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.175847    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:32:09.194470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.194443    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzssw\" (UniqueName: \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.194574 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.194556    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.194638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.194595    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.194638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.194616    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.194752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.194709    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.218746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.218713    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:32:09.218746 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.218727    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:32:09.218903 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.218779    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-2cltz\""
Oct 30 11:32:09.219420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.219404    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:32:09.219506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.219430    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:32:09.222979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.222958    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:09.226123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.226108    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.245815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.245796    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:09.295851 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.295826    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.295959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.295856    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.295959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.295884    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.295959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.295939    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdw6k\" (UniqueName: \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.296100 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.295995    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzssw\" (UniqueName: \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.296100 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.296023    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.296278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.296150    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.296278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.296196    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.296593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.296574    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.298288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.298263    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.298419 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.298334    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.298468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.298418    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.318933 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.318913    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:32:09.319025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.318957    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-vfxt9\""
Oct 30 11:32:09.319411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.319395    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:32:09.320630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.320613    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzssw\" (UniqueName: \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\") pod \"data-science-collector-collector-1\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.396790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.396739    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.396790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.396777    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.396933 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.396797    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h97\" (UniqueName: \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.396933 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.396825    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.397047 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.397010    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw6k\" (UniqueName: \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.397109 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.397074    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.397268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.397251    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.397508 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.397494    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.421254 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.421224    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdw6k\" (UniqueName: \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:09.459406 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.459386    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:09.497947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.497919    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.498106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.497961    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.498106 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.497979    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h97\" (UniqueName: \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.498716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.498699    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.500198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.500179    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.521778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.521754    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h97\" (UniqueName: \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\") pod \"data-science-collector-targetallocator-cd697d87d-bs8wv\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.537585 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.537565    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.769566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.769541    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:09.772479 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:09.772450    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6b373d_b640_4160_a4ef_7b42e7b67a84.slice/crio-0409f530b0252108a9f878827306070ebdd91408e11cafff99a0b2ac538e2dc9 WatchSource:0}: Error finding container 0409f530b0252108a9f878827306070ebdd91408e11cafff99a0b2ac538e2dc9: Status 404 returned error can't find the container with id 0409f530b0252108a9f878827306070ebdd91408e11cafff99a0b2ac538e2dc9
Oct 30 11:32:09.774618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.774588    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:09.774698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.774646    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:09.832915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.832891    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:09.835643 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:09.835615    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ce6393_f6df_4354_adcb_196b24e97ed1.slice/crio-2866b1e3b9e28b3c47cfd06274dec9c56d9db06f3d2e673cbefca60bacef7bfd WatchSource:0}: Error finding container 2866b1e3b9e28b3c47cfd06274dec9c56d9db06f3d2e673cbefca60bacef7bfd: Status 404 returned error can't find the container with id 2866b1e3b9e28b3c47cfd06274dec9c56d9db06f3d2e673cbefca60bacef7bfd
Oct 30 11:32:09.837639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.837602    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:09.837721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.837675    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:09.893985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.893947    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"3a6b373d-b640-4160-a4ef-7b42e7b67a84","Type":"ContainerStarted","Data":"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"}
Oct 30 11:32:09.894101 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.893999    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"3a6b373d-b640-4160-a4ef-7b42e7b67a84","Type":"ContainerStarted","Data":"0409f530b0252108a9f878827306070ebdd91408e11cafff99a0b2ac538e2dc9"}
Oct 30 11:32:09.895512 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.895491    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" event={"ID":"99ce6393-f6df-4354-adcb-196b24e97ed1","Type":"ContainerStarted","Data":"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"}
Oct 30 11:32:09.895600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.895521    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" event={"ID":"99ce6393-f6df-4354-adcb-196b24e97ed1","Type":"ContainerStarted","Data":"2866b1e3b9e28b3c47cfd06274dec9c56d9db06f3d2e673cbefca60bacef7bfd"}
Oct 30 11:32:09.895802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.895785    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:09.897096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.897072    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.168:8080/readyz\": dial tcp 10.133.0.168:8080: connect: connection refused"
Oct 30 11:32:09.938918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.938861    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=0.938844182 podStartE2EDuration="938.844182ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:09.937332866 +0000 UTC m=+2826.282924720" watchObservedRunningTime="2026-10-30 11:32:09.938844182 +0000 UTC m=+2826.284436037"
Oct 30 11:32:09.983140 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:09.983090    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" podStartSLOduration=0.983075542 podStartE2EDuration="983.075542ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:09.982750802 +0000 UTC m=+2826.328342657" watchObservedRunningTime="2026-10-30 11:32:09.983075542 +0000 UTC m=+2826.328667396"
Oct 30 11:32:10.901580 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:10.901510    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:11.549711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.549682    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:32:11.552947 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.552930    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:32:11.587783 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.587757    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:32:11.614718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.614692    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.614866 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.614733    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj64z\" (UniqueName: \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn\" (UID: \"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:32:11.644949 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.644922    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.715510 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.715481    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.715615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.715511    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj64z\" (UniqueName: \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn\" (UID: \"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:32:11.715615 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.715600    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.730557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.730532    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.739074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.739055    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj64z\" (UniqueName: \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn\" (UID: \"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:32:11.831864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.831842    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.861113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.861093    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:11.888309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:11.888289    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:32:12.167299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.167231    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:12.185875 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.185844    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:32:12.188878 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:12.188854    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod261cdc4a_b88c_483f_9ba8_b4d1fcc6c2c4.slice/crio-4522c980283722708c82d3fd0b967ebc41bf77482720fa3361acf9f8ce9aa184 WatchSource:0}: Error finding container 4522c980283722708c82d3fd0b967ebc41bf77482720fa3361acf9f8ce9aa184: Status 404 returned error can't find the container with id 4522c980283722708c82d3fd0b967ebc41bf77482720fa3361acf9f8ce9aa184
Oct 30 11:32:12.478609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.478582    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:32:12.481724 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:12.481699    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88e99592_bab8_48ab_a1e0_2bfddf8f9b8e.slice/crio-3a47da873d4dad67a051372ff9c92be0476e1eb79398528d5ef73f3295a77206 WatchSource:0}: Error finding container 3a47da873d4dad67a051372ff9c92be0476e1eb79398528d5ef73f3295a77206: Status 404 returned error can't find the container with id 3a47da873d4dad67a051372ff9c92be0476e1eb79398528d5ef73f3295a77206
Oct 30 11:32:12.911197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.911108    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e","Type":"ContainerStarted","Data":"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"}
Oct 30 11:32:12.911197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.911161    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e","Type":"ContainerStarted","Data":"3a47da873d4dad67a051372ff9c92be0476e1eb79398528d5ef73f3295a77206"}
Oct 30 11:32:12.911453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.911215    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:12.912776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.912748    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" event={"ID":"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4","Type":"ContainerStarted","Data":"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"}
Oct 30 11:32:12.912903 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.912787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" event={"ID":"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4","Type":"ContainerStarted","Data":"4522c980283722708c82d3fd0b967ebc41bf77482720fa3361acf9f8ce9aa184"}
Oct 30 11:32:12.953402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.953333    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=3.953316407 podStartE2EDuration="3.953316407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:12.952937193 +0000 UTC m=+2829.298529038" watchObservedRunningTime="2026-10-30 11:32:12.953316407 +0000 UTC m=+2829.298908264"
Oct 30 11:32:12.992452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:12.992402    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" podStartSLOduration=1.99238765 podStartE2EDuration="1.99238765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:12.991899505 +0000 UTC m=+2829.337491366" watchObservedRunningTime="2026-10-30 11:32:12.99238765 +0000 UTC m=+2829.337979505"
Oct 30 11:32:13.019095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.019063    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:13.019252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.019215    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" podUID="554db2b8-30a8-4ba4-84f5-14222c331665" containerName="thanos-querier" containerID="cri-o://5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f" gracePeriod=30
Oct 30 11:32:13.268953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.268930    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:13.427499 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.427463    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\" (UniqueName: \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\") pod \"554db2b8-30a8-4ba4-84f5-14222c331665\" (UID: \"554db2b8-30a8-4ba4-84f5-14222c331665\") "
Oct 30 11:32:13.429485 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.429453    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz" pod "554db2b8-30a8-4ba4-84f5-14222c331665" (UID: "554db2b8-30a8-4ba4-84f5-14222c331665"). InnerVolumeSpecName "kube-api-access-zhmjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:32:13.528511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.528480    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhmjz\" (UniqueName: \"kubernetes.io/projected/554db2b8-30a8-4ba4-84f5-14222c331665-kube-api-access-zhmjz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:13.918375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.918324    4488 generic.go:356] "Generic (PLEG): container finished" podID="554db2b8-30a8-4ba4-84f5-14222c331665" containerID="5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f" exitCode=0
Oct 30 11:32:13.918532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.918379    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" event={"ID":"554db2b8-30a8-4ba4-84f5-14222c331665","Type":"ContainerDied","Data":"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"}
Oct 30 11:32:13.918532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.918392    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"
Oct 30 11:32:13.918532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.918421    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r" event={"ID":"554db2b8-30a8-4ba4-84f5-14222c331665","Type":"ContainerDied","Data":"f439ab37ab6b10104fdd7478773f8cd8777a59033076349a0cb96d12c5d217e8"}
Oct 30 11:32:13.918532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.918441    4488 scope.go:122] "RemoveContainer" containerID="5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"
Oct 30 11:32:13.927651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.927631    4488 scope.go:122] "RemoveContainer" containerID="5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"
Oct 30 11:32:13.927988 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:13.927966    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f\": container with ID starting with 5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f not found: ID does not exist" containerID="5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"
Oct 30 11:32:13.928080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.927998    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f"} err="failed to get container status \"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f\": rpc error: code = NotFound desc = could not find container \"5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f\": container with ID starting with 5b9446d17fd07f65e198773e49afe8acdf22c1fedc913ca9e18a009ab3fb7c8f not found: ID does not exist"
Oct 30 11:32:13.972674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.972643    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:13.975711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:13.975688    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gng7r"]
Oct 30 11:32:15.802318 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:15.802282    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="554db2b8-30a8-4ba4-84f5-14222c331665" path="/var/lib/kubelet/pods/554db2b8-30a8-4ba4-84f5-14222c331665/volumes"
Oct 30 11:32:23.920295 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:23.920265    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:32:31.478964 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:31.478928    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:32:42.458448 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.458411    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:42.459053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.458658    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" containerName="otc-container" containerID="cri-o://232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5" gracePeriod=30
Oct 30 11:32:42.678474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.678439    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:42.678815 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.678797    4488 cpu_manager.go:414] "containerMap: removing container" podUID="554db2b8-30a8-4ba4-84f5-14222c331665" containerName="thanos-querier"
Oct 30 11:32:42.678906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.678818    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="554db2b8-30a8-4ba4-84f5-14222c331665" containerName="thanos-querier"
Oct 30 11:32:42.678962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.678922    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="554db2b8-30a8-4ba4-84f5-14222c331665" containerName="thanos-querier"
Oct 30 11:32:42.681788 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.681768    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.699759 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.699737    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:42.750620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.750568    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4g2\" (UniqueName: \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.750620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.750612    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.750768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.750723    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.851498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.851473    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.851598 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.851518    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4g2\" (UniqueName: \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.851598 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.851568    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.852198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.852182    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.853910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.853887    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.875556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.875529    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4g2\" (UniqueName: \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\") pod \"data-science-collector-targetallocator-867cc98d57-cqjg2\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:42.993064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:42.993042    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:43.288786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:43.288590    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:43.291510 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:43.291485    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc18a9dd5_9acb_4ec8_bf40_ec7e17af164f.slice/crio-a124e19dc6c0acf905b8cc7789fa19f71b9e7204c2216ba3d8286a983d6ab1ce WatchSource:0}: Error finding container a124e19dc6c0acf905b8cc7789fa19f71b9e7204c2216ba3d8286a983d6ab1ce: Status 404 returned error can't find the container with id a124e19dc6c0acf905b8cc7789fa19f71b9e7204c2216ba3d8286a983d6ab1ce
Oct 30 11:32:43.294001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:43.293969    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:43.294079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:43.294025    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:44.035741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.035702    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" event={"ID":"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f","Type":"ContainerStarted","Data":"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"}
Oct 30 11:32:44.035741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.035752    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" event={"ID":"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f","Type":"ContainerStarted","Data":"a124e19dc6c0acf905b8cc7789fa19f71b9e7204c2216ba3d8286a983d6ab1ce"}
Oct 30 11:32:44.036190 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.035775    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:44.037188 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.037165    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:44.079616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.079576    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" podStartSLOduration=2.079564262 podStartE2EDuration="2.079564262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:44.07826039 +0000 UTC m=+2860.423852241" watchObservedRunningTime="2026-10-30 11:32:44.079564262 +0000 UTC m=+2860.425156116"
Oct 30 11:32:44.154094 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.154066    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:44.154268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.154243    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerName="ta-container" containerID="cri-o://71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab" gracePeriod=30
Oct 30 11:32:44.388659 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.388637    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:44.465298 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.465255    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\" (UniqueName: \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\") pod \"99ce6393-f6df-4354-adcb-196b24e97ed1\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") "
Oct 30 11:32:44.465470 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.465357    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\" (UniqueName: \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\") pod \"99ce6393-f6df-4354-adcb-196b24e97ed1\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") "
Oct 30 11:32:44.465578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.465548    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\") pod \"99ce6393-f6df-4354-adcb-196b24e97ed1\" (UID: \"99ce6393-f6df-4354-adcb-196b24e97ed1\") "
Oct 30 11:32:44.465828 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.465797    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal" pod "99ce6393-f6df-4354-adcb-196b24e97ed1" (UID: "99ce6393-f6df-4354-adcb-196b24e97ed1"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:32:44.465926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.465892    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/99ce6393-f6df-4354-adcb-196b24e97ed1-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.467614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.467591    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert" pod "99ce6393-f6df-4354-adcb-196b24e97ed1" (UID: "99ce6393-f6df-4354-adcb-196b24e97ed1"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:32:44.467669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.467642    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97" pod "99ce6393-f6df-4354-adcb-196b24e97ed1" (UID: "99ce6393-f6df-4354-adcb-196b24e97ed1"). InnerVolumeSpecName "kube-api-access-28h97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:32:44.566275 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.566251    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/99ce6393-f6df-4354-adcb-196b24e97ed1-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.566404 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.566280    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28h97\" (UniqueName: \"kubernetes.io/projected/99ce6393-f6df-4354-adcb-196b24e97ed1-kube-api-access-28h97\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.784061 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.784036    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:44.869148 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869118    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\") pod \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") "
Oct 30 11:32:44.869269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869156    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\" (UniqueName: \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\") pod \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") "
Oct 30 11:32:44.869269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869214    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\") pod \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") "
Oct 30 11:32:44.869269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869254    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\") pod \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") "
Oct 30 11:32:44.869476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869453    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\" (UniqueName: \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\") pod \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\" (UID: \"3a6b373d-b640-4160-a4ef-7b42e7b67a84\") "
Oct 30 11:32:44.869606 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869585    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal" pod "3a6b373d-b640-4160-a4ef-7b42e7b67a84" (UID: "3a6b373d-b640-4160-a4ef-7b42e7b67a84"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:32:44.869721 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.869706    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3a6b373d-b640-4160-a4ef-7b42e7b67a84-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.871385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.871337    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw" pod "3a6b373d-b640-4160-a4ef-7b42e7b67a84" (UID: "3a6b373d-b640-4160-a4ef-7b42e7b67a84"). InnerVolumeSpecName "kube-api-access-lzssw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:32:44.871500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.871387    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert" pod "3a6b373d-b640-4160-a4ef-7b42e7b67a84" (UID: "3a6b373d-b640-4160-a4ef-7b42e7b67a84"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:32:44.871643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.871618    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs" pod "3a6b373d-b640-4160-a4ef-7b42e7b67a84" (UID: "3a6b373d-b640-4160-a4ef-7b42e7b67a84"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:32:44.871773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.871754    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs" pod "3a6b373d-b640-4160-a4ef-7b42e7b67a84" (UID: "3a6b373d-b640-4160-a4ef-7b42e7b67a84"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:32:44.970887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.970860    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.970887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.970887    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzssw\" (UniqueName: \"kubernetes.io/projected/3a6b373d-b640-4160-a4ef-7b42e7b67a84-kube-api-access-lzssw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.971051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.970901    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:44.971051 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:44.970914    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6b373d-b640-4160-a4ef-7b42e7b67a84-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:45.041613 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.041581    4488 generic.go:356] "Generic (PLEG): container finished" podID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerID="71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab" exitCode=0
Oct 30 11:32:45.041983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.041653    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"
Oct 30 11:32:45.041983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.041678    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" event={"ID":"99ce6393-f6df-4354-adcb-196b24e97ed1","Type":"ContainerDied","Data":"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"}
Oct 30 11:32:45.041983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.041718    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv" event={"ID":"99ce6393-f6df-4354-adcb-196b24e97ed1","Type":"ContainerDied","Data":"2866b1e3b9e28b3c47cfd06274dec9c56d9db06f3d2e673cbefca60bacef7bfd"}
Oct 30 11:32:45.041983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.041736    4488 scope.go:122] "RemoveContainer" containerID="71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"
Oct 30 11:32:45.043035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.043004    4488 generic.go:356] "Generic (PLEG): container finished" podID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" containerID="232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5" exitCode=0
Oct 30 11:32:45.043143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.043035    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"3a6b373d-b640-4160-a4ef-7b42e7b67a84","Type":"ContainerDied","Data":"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"}
Oct 30 11:32:45.043143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.043058    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:45.043143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.043081    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"3a6b373d-b640-4160-a4ef-7b42e7b67a84","Type":"ContainerDied","Data":"0409f530b0252108a9f878827306070ebdd91408e11cafff99a0b2ac538e2dc9"}
Oct 30 11:32:45.050608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.050501    4488 scope.go:122] "RemoveContainer" containerID="71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"
Oct 30 11:32:45.050911 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:45.050884    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab\": container with ID starting with 71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab not found: ID does not exist" containerID="71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"
Oct 30 11:32:45.050980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.050924    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab"} err="failed to get container status \"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab\": rpc error: code = NotFound desc = could not find container \"71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab\": container with ID starting with 71277291d1766e0414fd2b115a1dd0b24ac90b5ef68a20a4e6634c0af569e0ab not found: ID does not exist"
Oct 30 11:32:45.050980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.050940    4488 scope.go:122] "RemoveContainer" containerID="232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"
Oct 30 11:32:45.058200 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.058187    4488 scope.go:122] "RemoveContainer" containerID="232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"
Oct 30 11:32:45.058502 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:45.058485    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5\": container with ID starting with 232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5 not found: ID does not exist" containerID="232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"
Oct 30 11:32:45.058556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.058508    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5"} err="failed to get container status \"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5\": rpc error: code = NotFound desc = could not find container \"232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5\": container with ID starting with 232154a6b1b7aa5eba48d475560782d6ccdd4b221d4694f1ff6acbf0e26aa7a5 not found: ID does not exist"
Oct 30 11:32:45.094449 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.094422    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:45.107024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.107000    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cd697d87d-bs8wv"]
Oct 30 11:32:45.132813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.132758    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:45.137046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.137023    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:45.803103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.803063    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" path="/var/lib/kubelet/pods/3a6b373d-b640-4160-a4ef-7b42e7b67a84/volumes"
Oct 30 11:32:45.803553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:45.803530    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" path="/var/lib/kubelet/pods/99ce6393-f6df-4354-adcb-196b24e97ed1/volumes"
Oct 30 11:32:49.879057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.878971    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879275    4488 cpu_manager.go:414] "containerMap: removing container" podUID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" containerName="otc-container"
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879289    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" containerName="otc-container"
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879303    4488 cpu_manager.go:414] "containerMap: removing container" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerName="ta-container"
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879308    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerName="ta-container"
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879391    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a6b373d-b640-4160-a4ef-7b42e7b67a84" containerName="otc-container"
Oct 30 11:32:49.879444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.879399    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="99ce6393-f6df-4354-adcb-196b24e97ed1" containerName="ta-container"
Oct 30 11:32:49.883428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.883411    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:49.904970 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:49.904947    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:32:50.009794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.009760    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.009951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.009806    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxkq\" (UniqueName: \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.009951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.009892    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.110601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.110563    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.110784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.110655    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.110784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.110701    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxkq\" (UniqueName: \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.111247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.111226    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.112807 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.112788    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.134181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.134131    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxkq\" (UniqueName: \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\") pod \"data-science-collector-targetallocator-5997dddd76-q9v4p\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.194863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.194841    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:50.454017 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.451767    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:50.457391 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.457364    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.472478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.472448    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:50.489474 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.489447    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:32:50.492571 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.492552    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:32:50.493822 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:50.493795    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8c62253_e72f_4c79_a87f_10ab637f408f.slice/crio-6c9a2b5727711e8ddae23ebefc529749aced6f4ef18b30cda0d2543c8944c32e WatchSource:0}: Error finding container 6c9a2b5727711e8ddae23ebefc529749aced6f4ef18b30cda0d2543c8944c32e: Status 404 returned error can't find the container with id 6c9a2b5727711e8ddae23ebefc529749aced6f4ef18b30cda0d2543c8944c32e
Oct 30 11:32:50.495876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.495845    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:50.495978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.495895    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:50.512976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.512934    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:32:50.521632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.521615    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-2cltz\""
Oct 30 11:32:50.522164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.522147    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:32:50.522202 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.522156    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:32:50.614643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.614607    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6rs\" (UniqueName: \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.614800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.614652    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.614800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.614774    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.614954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.614842    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.614954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.614887    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.715376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.715289    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.715376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.715331    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.715578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.715459    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.715578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.715551    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6rs\" (UniqueName: \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.715578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.715576    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.716084 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.716062    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.717962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.717934    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.718128 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.718035    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.718128 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.718078    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.739494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.739475    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6rs\" (UniqueName: \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\") pod \"data-science-collector-collector-1\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:50.770572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:50.770551    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:32:51.067763 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.067630    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:32:51.070229 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:32:51.070206    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf1b8ec_71e9_4c6a_b758_4da4e07c4790.slice/crio-5ef2f22705122b29b6357acd4eef5db08ac025cac657e8d1b363e91777fa69ab WatchSource:0}: Error finding container 5ef2f22705122b29b6357acd4eef5db08ac025cac657e8d1b363e91777fa69ab: Status 404 returned error can't find the container with id 5ef2f22705122b29b6357acd4eef5db08ac025cac657e8d1b363e91777fa69ab
Oct 30 11:32:51.071090 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.071014    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" event={"ID":"b8c62253-e72f-4c79-a87f-10ab637f408f","Type":"ContainerStarted","Data":"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"}
Oct 30 11:32:51.071090 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.071056    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" event={"ID":"b8c62253-e72f-4c79-a87f-10ab637f408f","Type":"ContainerStarted","Data":"6c9a2b5727711e8ddae23ebefc529749aced6f4ef18b30cda0d2543c8944c32e"}
Oct 30 11:32:51.071212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.071165    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:51.072494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.072457    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:51.072596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.072530    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:32:51.072596 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.072587    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:32:51.113899 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.113854    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" podStartSLOduration=2.113837115 podStartE2EDuration="2.113837115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:51.112893397 +0000 UTC m=+2867.458485252" watchObservedRunningTime="2026-10-30 11:32:51.113837115 +0000 UTC m=+2867.459428969"
Oct 30 11:32:51.190029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.189994    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:51.190244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.190219    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" podUID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" containerName="ta-container" containerID="cri-o://d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155" gracePeriod=30
Oct 30 11:32:51.431060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.431037    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:51.523402 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.523373    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\") pod \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") "
Oct 30 11:32:51.523569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.523461    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\") pod \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") "
Oct 30 11:32:51.523569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.523496    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\" (UniqueName: \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\") pod \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\" (UID: \"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f\") "
Oct 30 11:32:51.523797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.523776    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal" pod "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" (UID: "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:32:51.525493 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.525473    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2" pod "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" (UID: "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f"). InnerVolumeSpecName "kube-api-access-xd4g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:32:51.525584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.525548    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert" pod "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" (UID: "c18a9dd5-9acb-4ec8-bf40-ec7e17af164f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:32:51.624035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.623985    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:51.624035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.624008    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd4g2\" (UniqueName: \"kubernetes.io/projected/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-kube-api-access-xd4g2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:51.624035 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:51.624018    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:32:52.076957 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.076927    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790","Type":"ContainerStarted","Data":"db2807e784fd9ac7f61a38fe8d673e74b82cbd05f277b4729812bf15ed404801"}
Oct 30 11:32:52.077420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.076977    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790","Type":"ContainerStarted","Data":"5ef2f22705122b29b6357acd4eef5db08ac025cac657e8d1b363e91777fa69ab"}
Oct 30 11:32:52.078171 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.078149    4488 generic.go:356] "Generic (PLEG): container finished" podID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" containerID="d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155" exitCode=0
Oct 30 11:32:52.078281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.078182    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"
Oct 30 11:32:52.078281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.078215    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" event={"ID":"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f","Type":"ContainerDied","Data":"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"}
Oct 30 11:32:52.078281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.078244    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2" event={"ID":"c18a9dd5-9acb-4ec8-bf40-ec7e17af164f","Type":"ContainerDied","Data":"a124e19dc6c0acf905b8cc7789fa19f71b9e7204c2216ba3d8286a983d6ab1ce"}
Oct 30 11:32:52.078281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.078263    4488 scope.go:122] "RemoveContainer" containerID="d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"
Oct 30 11:32:52.089329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.089308    4488 scope.go:122] "RemoveContainer" containerID="d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"
Oct 30 11:32:52.089637 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:32:52.089618    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155\": container with ID starting with d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155 not found: ID does not exist" containerID="d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"
Oct 30 11:32:52.089698 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.089644    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155"} err="failed to get container status \"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155\": rpc error: code = NotFound desc = could not find container \"d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155\": container with ID starting with d223f92647ce40c76a96b320d954f9bb5c214faf7c54c430b7348c7ba035b155 not found: ID does not exist"
Oct 30 11:32:52.120459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.120413    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.120402131 podStartE2EDuration="2.120402131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:32:52.119022261 +0000 UTC m=+2868.464614117" watchObservedRunningTime="2026-10-30 11:32:52.120402131 +0000 UTC m=+2868.465993979"
Oct 30 11:32:52.158308 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.158275    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:52.161588 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:52.161565    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cc98d57-cqjg2"]
Oct 30 11:32:53.802186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:32:53.802154    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" path="/var/lib/kubelet/pods/c18a9dd5-9acb-4ec8-bf40-ec7e17af164f/volumes"
Oct 30 11:33:01.478383 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:01.478331    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:33:14.945164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:14.945133    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:14.945701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:14.945333    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" containerName="otc-container" containerID="cri-o://db2807e784fd9ac7f61a38fe8d673e74b82cbd05f277b4729812bf15ed404801" gracePeriod=30
Oct 30 11:33:15.157569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.157525    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:15.157916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.157894    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" containerName="ta-container"
Oct 30 11:33:15.157916 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.157914    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" containerName="ta-container"
Oct 30 11:33:15.158090 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.157976    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c18a9dd5-9acb-4ec8-bf40-ec7e17af164f" containerName="ta-container"
Oct 30 11:33:15.162420 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.162403    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.180594 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.180575    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:15.298136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.298080    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.298136 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.298124    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.298277 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.298196    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qslnj\" (UniqueName: \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.398910 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.398884    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.399015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.398924    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.399015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.398945    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qslnj\" (UniqueName: \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.399536 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.399516    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.401273 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.401251    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.422487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.422464    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qslnj\" (UniqueName: \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\") pod \"data-science-collector-targetallocator-7465468b7f-4ppnm\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.473811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.473792    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:15.768239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.768210    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:15.771807 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:15.771781    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5b3b370_6cd4_4058_8a87_0602328d2c57.slice/crio-145dd453374e9571129e89da364a6a031d4519e3213b2d718de6403fdffaa6f5 WatchSource:0}: Error finding container 145dd453374e9571129e89da364a6a031d4519e3213b2d718de6403fdffaa6f5: Status 404 returned error can't find the container with id 145dd453374e9571129e89da364a6a031d4519e3213b2d718de6403fdffaa6f5
Oct 30 11:33:15.773876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.773845    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:15.773946 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:15.773902    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:16.172431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.172402    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" event={"ID":"c5b3b370-6cd4-4058-8a87-0602328d2c57","Type":"ContainerStarted","Data":"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"}
Oct 30 11:33:16.172858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.172440    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" event={"ID":"c5b3b370-6cd4-4058-8a87-0602328d2c57","Type":"ContainerStarted","Data":"145dd453374e9571129e89da364a6a031d4519e3213b2d718de6403fdffaa6f5"}
Oct 30 11:33:16.172858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.172536    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:16.174020 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.174001    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:16.215845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.215804    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" podStartSLOduration=1.2157925490000001 podStartE2EDuration="1.215792549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:16.215073563 +0000 UTC m=+2892.560665418" watchObservedRunningTime="2026-10-30 11:33:16.215792549 +0000 UTC m=+2892.561384404"
Oct 30 11:33:16.289478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.289450    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:33:16.289703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.289679    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" podUID="b8c62253-e72f-4c79-a87f-10ab637f408f" containerName="ta-container" containerID="cri-o://bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66" gracePeriod=30
Oct 30 11:33:16.530495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.530469    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:33:16.711376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.711295    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\") pod \"b8c62253-e72f-4c79-a87f-10ab637f408f\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") "
Oct 30 11:33:16.711376 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.711335    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\") pod \"b8c62253-e72f-4c79-a87f-10ab637f408f\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") "
Oct 30 11:33:16.711556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.711382    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\" (UniqueName: \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\") pod \"b8c62253-e72f-4c79-a87f-10ab637f408f\" (UID: \"b8c62253-e72f-4c79-a87f-10ab637f408f\") "
Oct 30 11:33:16.711673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.711644    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal" pod "b8c62253-e72f-4c79-a87f-10ab637f408f" (UID: "b8c62253-e72f-4c79-a87f-10ab637f408f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:16.713489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.713463    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq" pod "b8c62253-e72f-4c79-a87f-10ab637f408f" (UID: "b8c62253-e72f-4c79-a87f-10ab637f408f"). InnerVolumeSpecName "kube-api-access-xvxkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:16.713616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.713597    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert" pod "b8c62253-e72f-4c79-a87f-10ab637f408f" (UID: "b8c62253-e72f-4c79-a87f-10ab637f408f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:16.812521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.812498    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b8c62253-e72f-4c79-a87f-10ab637f408f-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:16.812521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.812519    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b8c62253-e72f-4c79-a87f-10ab637f408f-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:16.812648 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:16.812528    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxkq\" (UniqueName: \"kubernetes.io/projected/b8c62253-e72f-4c79-a87f-10ab637f408f-kube-api-access-xvxkq\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.178673 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.178640    4488 generic.go:356] "Generic (PLEG): container finished" podID="b8c62253-e72f-4c79-a87f-10ab637f408f" containerID="bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66" exitCode=0
Oct 30 11:33:17.179057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.178687    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"
Oct 30 11:33:17.179057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.178707    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" event={"ID":"b8c62253-e72f-4c79-a87f-10ab637f408f","Type":"ContainerDied","Data":"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"}
Oct 30 11:33:17.179057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.178754    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p" event={"ID":"b8c62253-e72f-4c79-a87f-10ab637f408f","Type":"ContainerDied","Data":"6c9a2b5727711e8ddae23ebefc529749aced6f4ef18b30cda0d2543c8944c32e"}
Oct 30 11:33:17.179057 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.178780    4488 scope.go:122] "RemoveContainer" containerID="bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"
Oct 30 11:33:17.180681 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.180654    4488 generic.go:356] "Generic (PLEG): container finished" podID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" containerID="db2807e784fd9ac7f61a38fe8d673e74b82cbd05f277b4729812bf15ed404801" exitCode=0
Oct 30 11:33:17.181110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.181092    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790","Type":"ContainerDied","Data":"db2807e784fd9ac7f61a38fe8d673e74b82cbd05f277b4729812bf15ed404801"}
Oct 30 11:33:17.186951 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.186933    4488 scope.go:122] "RemoveContainer" containerID="bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"
Oct 30 11:33:17.188259 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:17.188238    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66\": container with ID starting with bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66 not found: ID does not exist" containerID="bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"
Oct 30 11:33:17.188361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.188267    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66"} err="failed to get container status \"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66\": rpc error: code = NotFound desc = could not find container \"bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66\": container with ID starting with bb471dcb20efca4fbb7753d481d3bdf7284b62946cc2a78107952c9eb3c42d66 not found: ID does not exist"
Oct 30 11:33:17.231616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.231592    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:33:17.244454 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.244432    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5997dddd76-q9v4p"]
Oct 30 11:33:17.277328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.277308    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:17.418415 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418389    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\") pod \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") "
Oct 30 11:33:17.418535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418434    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\" (UniqueName: \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\") pod \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") "
Oct 30 11:33:17.418535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418458    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\" (UniqueName: \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\") pod \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") "
Oct 30 11:33:17.418622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418571    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\") pod \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") "
Oct 30 11:33:17.418666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418639    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\") pod \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\" (UID: \"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790\") "
Oct 30 11:33:17.418850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.418826    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal" pod "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" (UID: "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:17.420667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.420638    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs" pod "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" (UID: "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:17.420667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.420649    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs" pod "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" (UID: "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:17.421014 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.420986    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs" pod "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" (UID: "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790"). InnerVolumeSpecName "kube-api-access-ns6rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:17.421102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.421048    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert" pod "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" (UID: "2bf1b8ec-71e9-4c6a-b758-4da4e07c4790"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:17.519892 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.519860    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.519892 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.519887    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.520067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.519901    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.520067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.519910    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6rs\" (UniqueName: \"kubernetes.io/projected/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-kube-api-access-ns6rs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.520067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.519920    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:17.802279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:17.802246    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8c62253-e72f-4c79-a87f-10ab637f408f" path="/var/lib/kubelet/pods/b8c62253-e72f-4c79-a87f-10ab637f408f/volumes"
Oct 30 11:33:18.186618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.186594    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.187001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.186620    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2bf1b8ec-71e9-4c6a-b758-4da4e07c4790","Type":"ContainerDied","Data":"5ef2f22705122b29b6357acd4eef5db08ac025cac657e8d1b363e91777fa69ab"}
Oct 30 11:33:18.187001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.186706    4488 scope.go:122] "RemoveContainer" containerID="db2807e784fd9ac7f61a38fe8d673e74b82cbd05f277b4729812bf15ed404801"
Oct 30 11:33:18.240032 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.240010    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:18.253601 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.253579    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:18.280370 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280337    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:18.280663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280649    4488 cpu_manager.go:414] "containerMap: removing container" podUID="b8c62253-e72f-4c79-a87f-10ab637f408f" containerName="ta-container"
Oct 30 11:33:18.280707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280664    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8c62253-e72f-4c79-a87f-10ab637f408f" containerName="ta-container"
Oct 30 11:33:18.280707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280680    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" containerName="otc-container"
Oct 30 11:33:18.280707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280686    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" containerName="otc-container"
Oct 30 11:33:18.280810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280735    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8c62253-e72f-4c79-a87f-10ab637f408f" containerName="ta-container"
Oct 30 11:33:18.280810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.280749    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" containerName="otc-container"
Oct 30 11:33:18.284817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.284802    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.305675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.305651    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:18.306203 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.306187    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:33:18.307374 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.307356    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:33:18.307588 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.307572    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:33:18.307678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.307635    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:33:18.316743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.316725    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-2cltz\""
Oct 30 11:33:18.426766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.426741    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.426863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.426783    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.426911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.426859    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsqz\" (UniqueName: \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.426911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.426883    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.426986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.426920    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.527884 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.527823    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.527884 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.527867    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.528108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.527889    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsqz\" (UniqueName: \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.528108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.527910    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.528108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.527938    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.528637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.528617    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.530364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.530321    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.530610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.530590    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.530679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.530593    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.562253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.562228    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsqz\" (UniqueName: \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\") pod \"data-science-collector-collector-1\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.596040 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.596019    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:18.886159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.886088    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:33:18.886336 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.886305    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" podUID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" containerName="thanos-querier" containerID="cri-o://1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42" gracePeriod=30
Oct 30 11:33:18.897878 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.897847    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:18.902779 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:18.902748    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195aa0f3_9371_44de_aa21_8ac2424dd238.slice/crio-9a4f06f0e1d46dcbf1565291ead1822136139105b6aec3cdcbe5722e19d8f1ff WatchSource:0}: Error finding container 9a4f06f0e1d46dcbf1565291ead1822136139105b6aec3cdcbe5722e19d8f1ff: Status 404 returned error can't find the container with id 9a4f06f0e1d46dcbf1565291ead1822136139105b6aec3cdcbe5722e19d8f1ff
Oct 30 11:33:18.993537 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.993494    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:18.993671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:18.993575    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:19.143690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.143625    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:33:19.193664 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.193612    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"195aa0f3-9371-44de-aa21-8ac2424dd238","Type":"ContainerStarted","Data":"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"}
Oct 30 11:33:19.194123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.193678    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"195aa0f3-9371-44de-aa21-8ac2424dd238","Type":"ContainerStarted","Data":"9a4f06f0e1d46dcbf1565291ead1822136139105b6aec3cdcbe5722e19d8f1ff"}
Oct 30 11:33:19.195123 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.195093    4488 generic.go:356] "Generic (PLEG): container finished" podID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" containerID="1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42" exitCode=0
Oct 30 11:33:19.195266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.195120    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"
Oct 30 11:33:19.195266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.195171    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" event={"ID":"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4","Type":"ContainerDied","Data":"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"}
Oct 30 11:33:19.195266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.195214    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn" event={"ID":"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4","Type":"ContainerDied","Data":"4522c980283722708c82d3fd0b967ebc41bf77482720fa3361acf9f8ce9aa184"}
Oct 30 11:33:19.195266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.195238    4488 scope.go:122] "RemoveContainer" containerID="1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"
Oct 30 11:33:19.203882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.203862    4488 scope.go:122] "RemoveContainer" containerID="1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"
Oct 30 11:33:19.204146 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:19.204124    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42\": container with ID starting with 1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42 not found: ID does not exist" containerID="1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"
Oct 30 11:33:19.204219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.204157    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42"} err="failed to get container status \"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42\": rpc error: code = NotFound desc = could not find container \"1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42\": container with ID starting with 1fdb7a7c7ee905b36b376e051455369366afa6987de3eef13779b0983f887d42 not found: ID does not exist"
Oct 30 11:33:19.240008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.239973    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.239960615 podStartE2EDuration="1.239960615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:19.239679005 +0000 UTC m=+2895.585270876" watchObservedRunningTime="2026-10-30 11:33:19.239960615 +0000 UTC m=+2895.585552469"
Oct 30 11:33:19.333938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.333907    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\" (UniqueName: \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\") pod \"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4\" (UID: \"261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4\") "
Oct 30 11:33:19.335976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.335954    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z" pod "261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" (UID: "261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4"). InnerVolumeSpecName "kube-api-access-mj64z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:19.434645 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.434619    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj64z\" (UniqueName: \"kubernetes.io/projected/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4-kube-api-access-mj64z\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:19.539501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.539477    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:33:19.542640 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.542617    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-sx8kn"]
Oct 30 11:33:19.802337 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.802261    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" path="/var/lib/kubelet/pods/261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4/volumes"
Oct 30 11:33:19.802667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:19.802653    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bf1b8ec-71e9-4c6a-b758-4da4e07c4790" path="/var/lib/kubelet/pods/2bf1b8ec-71e9-4c6a-b758-4da4e07c4790/volumes"
Oct 30 11:33:20.174931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.174901    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:20.201755 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.201730    4488 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="redhat-ods-monitoring/data-science-collector-collector-1" secret="" err="secret \"data-science-collector-collector-dockercfg-2cltz\" not found"
Oct 30 11:33:20.221058 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.221030    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:20.221233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.221207    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" podUID="c5b3b370-6cd4-4058-8a87-0602328d2c57" containerName="ta-container" containerID="cri-o://67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8" gracePeriod=30
Oct 30 11:33:20.307442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.307412    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:20.307622 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.307598    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" containerName="perses" containerID="cri-o://75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7" gracePeriod=30
Oct 30 11:33:20.341388 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:20.341364    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-collector-e4cadd38: configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:33:20.341482 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:20.341438    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal podName:195aa0f3-9371-44de-aa21-8ac2424dd238 nodeName:}" failed. No retries permitted until 2026-10-30 11:33:20.841418571 +0000 UTC m=+2897.187010427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otc-internal" (UniqueName: "kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal") pod "data-science-collector-collector-1" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238") : configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:33:20.547693 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.547671    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:20.574292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.574270    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:20.645147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.645121    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\") pod \"c5b3b370-6cd4-4058-8a87-0602328d2c57\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") "
Oct 30 11:33:20.645283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.645224    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\") pod \"c5b3b370-6cd4-4058-8a87-0602328d2c57\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") "
Oct 30 11:33:20.645283 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.645258    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\" (UniqueName: \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\") pod \"c5b3b370-6cd4-4058-8a87-0602328d2c57\" (UID: \"c5b3b370-6cd4-4058-8a87-0602328d2c57\") "
Oct 30 11:33:20.645553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.645533    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal" pod "c5b3b370-6cd4-4058-8a87-0602328d2c57" (UID: "c5b3b370-6cd4-4058-8a87-0602328d2c57"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:20.647220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.647196    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert" pod "c5b3b370-6cd4-4058-8a87-0602328d2c57" (UID: "c5b3b370-6cd4-4058-8a87-0602328d2c57"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:20.647331 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.647290    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj" pod "c5b3b370-6cd4-4058-8a87-0602328d2c57" (UID: "c5b3b370-6cd4-4058-8a87-0602328d2c57"). InnerVolumeSpecName "kube-api-access-qslnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:20.746201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746145    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\" (UniqueName: \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\") pod \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") "
Oct 30 11:33:20.746292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746224    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") "
Oct 30 11:33:20.746292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746281    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\" (UniqueName: \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\") pod \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") "
Oct 30 11:33:20.746462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746307    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\" (UniqueName: \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\") pod \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\" (UID: \"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e\") "
Oct 30 11:33:20.746552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746535    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c5b3b370-6cd4-4058-8a87-0602328d2c57-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.746617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746558    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qslnj\" (UniqueName: \"kubernetes.io/projected/c5b3b370-6cd4-4058-8a87-0602328d2c57-kube-api-access-qslnj\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.746617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746572    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c5b3b370-6cd4-4058-8a87-0602328d2c57-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.746729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.746647    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config" pod "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" (UID: "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:20.748312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.748289    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k" pod "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" (UID: "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e"). InnerVolumeSpecName "kube-api-access-tdw6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:20.748841 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.748822    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" (UID: "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:33:20.846935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.846911    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:33:20.846935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.846933    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.847121 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.846944    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdw6k\" (UniqueName: \"kubernetes.io/projected/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-kube-api-access-tdw6k\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.847121 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:20.846996    4488 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-collector-e4cadd38: configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:33:20.847121 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:20.847076    4488 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal podName:195aa0f3-9371-44de-aa21-8ac2424dd238 nodeName:}" failed. No retries permitted until 2026-10-30 11:33:21.847056276 +0000 UTC m=+2898.192648123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "otc-internal" (UniqueName: "kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal") pod "data-science-collector-collector-1" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238") : configmap "data-science-collector-collector-e4cadd38" not found
Oct 30 11:33:20.859701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.859686    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:33:20.895227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.895200    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins" pod "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" (UID: "88e99592-bab8-48ab-a1e0-2bfddf8f9b8e"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:33:20.947453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.947432    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:20.947453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:20.947451    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:33:21.208202 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.208163    4488 generic.go:356] "Generic (PLEG): container finished" podID="c5b3b370-6cd4-4058-8a87-0602328d2c57" containerID="67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8" exitCode=0
Oct 30 11:33:21.208646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.208210    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"
Oct 30 11:33:21.208646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.208237    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" event={"ID":"c5b3b370-6cd4-4058-8a87-0602328d2c57","Type":"ContainerDied","Data":"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"}
Oct 30 11:33:21.208646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.208285    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm" event={"ID":"c5b3b370-6cd4-4058-8a87-0602328d2c57","Type":"ContainerDied","Data":"145dd453374e9571129e89da364a6a031d4519e3213b2d718de6403fdffaa6f5"}
Oct 30 11:33:21.208646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.208303    4488 scope.go:122] "RemoveContainer" containerID="67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"
Oct 30 11:33:21.210044 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.210019    4488 generic.go:356] "Generic (PLEG): container finished" podID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" containerID="75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7" exitCode=0
Oct 30 11:33:21.210151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.210077    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:21.210151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.210082    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e","Type":"ContainerDied","Data":"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"}
Oct 30 11:33:21.210151 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.210133    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"88e99592-bab8-48ab-a1e0-2bfddf8f9b8e","Type":"ContainerDied","Data":"3a47da873d4dad67a051372ff9c92be0476e1eb79398528d5ef73f3295a77206"}
Oct 30 11:33:21.210514 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.210489    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="195aa0f3-9371-44de-aa21-8ac2424dd238" containerName="otc-container" containerID="cri-o://0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af" gracePeriod=30
Oct 30 11:33:21.218518 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.218501    4488 scope.go:122] "RemoveContainer" containerID="67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"
Oct 30 11:33:21.218959 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:21.218870    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8\": container with ID starting with 67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8 not found: ID does not exist" containerID="67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"
Oct 30 11:33:21.219153 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.219120    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8"} err="failed to get container status \"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8\": rpc error: code = NotFound desc = could not find container \"67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8\": container with ID starting with 67be18d1a61a83934df20d99216c98bfc656b5569d512902ee7f2d9a70b63cb8 not found: ID does not exist"
Oct 30 11:33:21.220299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.219188    4488 scope.go:122] "RemoveContainer" containerID="75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"
Oct 30 11:33:21.227784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.227573    4488 scope.go:122] "RemoveContainer" containerID="75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"
Oct 30 11:33:21.227830 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:21.227807    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7\": container with ID starting with 75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7 not found: ID does not exist" containerID="75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"
Oct 30 11:33:21.227909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.227830    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7"} err="failed to get container status \"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7\": rpc error: code = NotFound desc = could not find container \"75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7\": container with ID starting with 75d3be8426763309092aea9830ed3f687d0bdb51d1afa57576ffb7532e8df3e7 not found: ID does not exist"
Oct 30 11:33:21.260590 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.260556    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:21.262201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.262180    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7465468b7f-4ppnm"]
Oct 30 11:33:21.339135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.339113    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:21.342031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.342009    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:21.437295 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.437275    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:21.554104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554078    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\") pod \"195aa0f3-9371-44de-aa21-8ac2424dd238\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") "
Oct 30 11:33:21.554232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554118    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\") pod \"195aa0f3-9371-44de-aa21-8ac2424dd238\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") "
Oct 30 11:33:21.554232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554181    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\" (UniqueName: \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\") pod \"195aa0f3-9371-44de-aa21-8ac2424dd238\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") "
Oct 30 11:33:21.554232 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554213    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\" (UniqueName: \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\") pod \"195aa0f3-9371-44de-aa21-8ac2424dd238\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") "
Oct 30 11:33:21.554447 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554375    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\") pod \"195aa0f3-9371-44de-aa21-8ac2424dd238\" (UID: \"195aa0f3-9371-44de-aa21-8ac2424dd238\") "
Oct 30 11:33:21.554612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.554583    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal" pod "195aa0f3-9371-44de-aa21-8ac2424dd238" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:21.556222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.556197    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert" pod "195aa0f3-9371-44de-aa21-8ac2424dd238" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:21.556373 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.556333    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs" pod "195aa0f3-9371-44de-aa21-8ac2424dd238" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:21.556427 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.556390    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs" pod "195aa0f3-9371-44de-aa21-8ac2424dd238" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:21.556479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.556455    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz" pod "195aa0f3-9371-44de-aa21-8ac2424dd238" (UID: "195aa0f3-9371-44de-aa21-8ac2424dd238"). InnerVolumeSpecName "kube-api-access-qdsqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:21.655157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.655133    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/195aa0f3-9371-44de-aa21-8ac2424dd238-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:21.655157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.655155    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsqz\" (UniqueName: \"kubernetes.io/projected/195aa0f3-9371-44de-aa21-8ac2424dd238-kube-api-access-qdsqz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:21.655288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.655165    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:21.655288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.655180    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:21.655288 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.655190    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/195aa0f3-9371-44de-aa21-8ac2424dd238-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:21.801937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.801882    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" path="/var/lib/kubelet/pods/88e99592-bab8-48ab-a1e0-2bfddf8f9b8e/volumes"
Oct 30 11:33:21.802247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:21.802234    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5b3b370-6cd4-4058-8a87-0602328d2c57" path="/var/lib/kubelet/pods/c5b3b370-6cd4-4058-8a87-0602328d2c57/volumes"
Oct 30 11:33:22.215532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.215504    4488 generic.go:356] "Generic (PLEG): container finished" podID="195aa0f3-9371-44de-aa21-8ac2424dd238" containerID="0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af" exitCode=0
Oct 30 11:33:22.215978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.215552    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:22.215978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.215585    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"195aa0f3-9371-44de-aa21-8ac2424dd238","Type":"ContainerDied","Data":"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"}
Oct 30 11:33:22.215978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.215632    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"195aa0f3-9371-44de-aa21-8ac2424dd238","Type":"ContainerDied","Data":"9a4f06f0e1d46dcbf1565291ead1822136139105b6aec3cdcbe5722e19d8f1ff"}
Oct 30 11:33:22.215978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.215650    4488 scope.go:122] "RemoveContainer" containerID="0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"
Oct 30 11:33:22.223223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.223199    4488 scope.go:122] "RemoveContainer" containerID="0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"
Oct 30 11:33:22.223488 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:22.223467    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af\": container with ID starting with 0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af not found: ID does not exist" containerID="0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"
Oct 30 11:33:22.223552 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.223498    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af"} err="failed to get container status \"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af\": rpc error: code = NotFound desc = could not find container \"0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af\": container with ID starting with 0633dce2bfe0a3558bdc1185dbdeb9866b8c52121210bc52d4d96dc1abf322af not found: ID does not exist"
Oct 30 11:33:22.269618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.269594    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:22.272036 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:22.272016    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:23.801723 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:23.801688    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="195aa0f3-9371-44de-aa21-8ac2424dd238" path="/var/lib/kubelet/pods/195aa0f3-9371-44de-aa21-8ac2424dd238/volumes"
Oct 30 11:33:26.983703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.983671    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.983964    4488 cpu_manager.go:414] "containerMap: removing container" podUID="195aa0f3-9371-44de-aa21-8ac2424dd238" containerName="otc-container"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.983977    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="195aa0f3-9371-44de-aa21-8ac2424dd238" containerName="otc-container"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.983990    4488 cpu_manager.go:414] "containerMap: removing container" podUID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" containerName="thanos-querier"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.983995    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" containerName="thanos-querier"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984008    4488 cpu_manager.go:414] "containerMap: removing container" podUID="c5b3b370-6cd4-4058-8a87-0602328d2c57" containerName="ta-container"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984013    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5b3b370-6cd4-4058-8a87-0602328d2c57" containerName="ta-container"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984020    4488 cpu_manager.go:414] "containerMap: removing container" podUID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" containerName="perses"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984025    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" containerName="perses"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984074    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5b3b370-6cd4-4058-8a87-0602328d2c57" containerName="ta-container"
Oct 30 11:33:26.984080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984083    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="88e99592-bab8-48ab-a1e0-2bfddf8f9b8e" containerName="perses"
Oct 30 11:33:26.984423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984092    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="195aa0f3-9371-44de-aa21-8ac2424dd238" containerName="otc-container"
Oct 30 11:33:26.984423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.984098    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="261cdc4a-b88c-483f-9ba8-b4d1fcc6c2c4" containerName="thanos-querier"
Oct 30 11:33:26.988689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.988666    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:26.991237 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:26.991209    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4qn\" (UniqueName: \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh\" (UID: \"9d432572-86b8-4a37-8cd8-6db47d2ae361\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:27.003104 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.003081    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:27.014931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.014901    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:33:27.014931 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.014925    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:33:27.015068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.015021    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:33:27.092078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.092051    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4qn\" (UniqueName: \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh\" (UID: \"9d432572-86b8-4a37-8cd8-6db47d2ae361\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:27.115915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.115895    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4qn\" (UniqueName: \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh\" (UID: \"9d432572-86b8-4a37-8cd8-6db47d2ae361\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:27.302460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.302400    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:27.596124 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.596039    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:27.600390 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:27.600363    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d432572_86b8_4a37_8cd8_6db47d2ae361.slice/crio-1c0c97d1139dddeca5daa01ea63388d400b86f611e618897f11b495cfcb38cbc WatchSource:0}: Error finding container 1c0c97d1139dddeca5daa01ea63388d400b86f611e618897f11b495cfcb38cbc: Status 404 returned error can't find the container with id 1c0c97d1139dddeca5daa01ea63388d400b86f611e618897f11b495cfcb38cbc
Oct 30 11:33:27.942876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.942833    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:27.946614 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.946573    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:27.966163 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.966140    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:27.978235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.978209    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:33:27.991909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.991878    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:27.995222 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:27.995203    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.016855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.016836    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:28.039489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.039465    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:28.041367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.041165    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:33:28.041367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.041244    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:33:28.041367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.041294    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:33:28.041367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.041320    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:33:28.041367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.041366    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dr7t6\""
Oct 30 11:33:28.042752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.042729    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.061564 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.061542    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:28.100513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100487    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.100513 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100512    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swcx\" (UniqueName: \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.100651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100548    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2drn\" (UniqueName: \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.100686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100648    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.100730 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100712    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.100779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100765    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.100816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100799    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.100848 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.100831    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.141489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.141464    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:33:28.141593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.141508    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:33:28.141637 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.141593    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-v2grs\""
Oct 30 11:33:28.201974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.201911    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.201974 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.201953    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.202116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202065    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.202177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202164    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.202235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202190    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.202235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202207    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swcx\" (UniqueName: \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.202389 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202243    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh54b\" (UniqueName: \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.202389 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202277    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2drn\" (UniqueName: \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.202389 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202375    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.202573 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202422    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.202573 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202485    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.202847 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202823    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.202960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.202913    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.203072 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.203055    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.204511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.204484    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.204600 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.204578    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.204647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.204609    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.225767 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.225745    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2drn\" (UniqueName: \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:28.225855 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.225839    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swcx\" (UniqueName: \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\") pod \"data-science-collector-collector-1\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.247414 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.247389    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" event={"ID":"9d432572-86b8-4a37-8cd8-6db47d2ae361","Type":"ContainerStarted","Data":"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"}
Oct 30 11:33:28.247530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.247425    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" event={"ID":"9d432572-86b8-4a37-8cd8-6db47d2ae361","Type":"ContainerStarted","Data":"1c0c97d1139dddeca5daa01ea63388d400b86f611e618897f11b495cfcb38cbc"}
Oct 30 11:33:28.258760 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.258742    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:28.287802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.287760    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" podStartSLOduration=2.287745648 podStartE2EDuration="2.287745648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:28.286825743 +0000 UTC m=+2904.632417596" watchObservedRunningTime="2026-10-30 11:33:28.287745648 +0000 UTC m=+2904.633337501"
Oct 30 11:33:28.303320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.303292    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh54b\" (UniqueName: \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.303479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.303352    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.303479 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.303404    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.304117 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.304093    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.306761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.306589    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.327557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.327537    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh54b\" (UniqueName: \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\") pod \"data-science-collector-targetallocator-799f9b6858-mg94c\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.354478 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.354458    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:28.555667 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.555585    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:28.559356 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:28.559318    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487de227_212b_42fb_b6ff_5c1bb4d246ca.slice/crio-26d4225892ce5523260f0233a0797563ef39684a9581b1cdd7e093d5d27ad031 WatchSource:0}: Error finding container 26d4225892ce5523260f0233a0797563ef39684a9581b1cdd7e093d5d27ad031: Status 404 returned error can't find the container with id 26d4225892ce5523260f0233a0797563ef39684a9581b1cdd7e093d5d27ad031
Oct 30 11:33:28.561530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.561497    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:28.561625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.561553    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:28.650083 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.650055    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:28.654033 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:28.654006    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5934da53_a565_4562_9ebb_b8eb3471de6a.slice/crio-4ea01201c977a105752403c7b54f0fe2adf08706e866f019979de12f33bed4d2 WatchSource:0}: Error finding container 4ea01201c977a105752403c7b54f0fe2adf08706e866f019979de12f33bed4d2: Status 404 returned error can't find the container with id 4ea01201c977a105752403c7b54f0fe2adf08706e866f019979de12f33bed4d2
Oct 30 11:33:28.656390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.656323    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:28.656534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:28.656417    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:29.253266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.253223    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" event={"ID":"5934da53-a565-4562-9ebb-b8eb3471de6a","Type":"ContainerStarted","Data":"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"}
Oct 30 11:33:29.253703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.253283    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:29.253703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.253302    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" event={"ID":"5934da53-a565-4562-9ebb-b8eb3471de6a","Type":"ContainerStarted","Data":"4ea01201c977a105752403c7b54f0fe2adf08706e866f019979de12f33bed4d2"}
Oct 30 11:33:29.255095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.255064    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"487de227-212b-42fb-b6ff-5c1bb4d246ca","Type":"ContainerStarted","Data":"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"}
Oct 30 11:33:29.255243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.255120    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"487de227-212b-42fb-b6ff-5c1bb4d246ca","Type":"ContainerStarted","Data":"26d4225892ce5523260f0233a0797563ef39684a9581b1cdd7e093d5d27ad031"}
Oct 30 11:33:29.255243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.255206    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:29.295904 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.295864    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" podStartSLOduration=1.295853474 podStartE2EDuration="1.295853474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:29.295222987 +0000 UTC m=+2905.640814841" watchObservedRunningTime="2026-10-30 11:33:29.295853474 +0000 UTC m=+2905.641445329"
Oct 30 11:33:29.339066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:29.338992    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.338977193 podStartE2EDuration="2.338977193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:29.338161744 +0000 UTC m=+2905.683753597" watchObservedRunningTime="2026-10-30 11:33:29.338977193 +0000 UTC m=+2905.684569047"
Oct 30 11:33:30.364826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.364791    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:33:30.368170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.368152    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:33:30.384929 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.384887    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:33:30.522231 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.522196    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhng6\" (UniqueName: \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c\" (UID: \"25a5a33a-64f8-4f23-8869-8d5c7de159e6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:33:30.623602 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.623536    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhng6\" (UniqueName: \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c\" (UID: \"25a5a33a-64f8-4f23-8869-8d5c7de159e6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:33:30.647404 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.647372    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhng6\" (UniqueName: \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c\" (UID: \"25a5a33a-64f8-4f23-8869-8d5c7de159e6\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:33:30.679412 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.679390    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:33:30.972511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:30.972476    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:33:30.976511 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:30.976483    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25a5a33a_64f8_4f23_8869_8d5c7de159e6.slice/crio-d43020c39deb17ca93159154f2fff1ac3dfea9c6c8aabdaa54aad8db04004979 WatchSource:0}: Error finding container d43020c39deb17ca93159154f2fff1ac3dfea9c6c8aabdaa54aad8db04004979: Status 404 returned error can't find the container with id d43020c39deb17ca93159154f2fff1ac3dfea9c6c8aabdaa54aad8db04004979
Oct 30 11:33:31.265058 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.264963    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" event={"ID":"25a5a33a-64f8-4f23-8869-8d5c7de159e6","Type":"ContainerStarted","Data":"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"}
Oct 30 11:33:31.265058 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.265022    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" event={"ID":"25a5a33a-64f8-4f23-8869-8d5c7de159e6","Type":"ContainerStarted","Data":"d43020c39deb17ca93159154f2fff1ac3dfea9c6c8aabdaa54aad8db04004979"}
Oct 30 11:33:31.306146 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.306099    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" podStartSLOduration=1.306086162 podStartE2EDuration="1.306086162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:31.305507106 +0000 UTC m=+2907.651098962" watchObservedRunningTime="2026-10-30 11:33:31.306086162 +0000 UTC m=+2907.651678015"
Oct 30 11:33:31.336432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.336401    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:31.336592 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.336567    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" podUID="9d432572-86b8-4a37-8cd8-6db47d2ae361" containerName="thanos-querier" containerID="cri-o://81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196" gracePeriod=30
Oct 30 11:33:31.479664 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:31.479629    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:33:31.566512 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.566489    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:31.733724 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.733685    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\" (UniqueName: \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\") pod \"9d432572-86b8-4a37-8cd8-6db47d2ae361\" (UID: \"9d432572-86b8-4a37-8cd8-6db47d2ae361\") "
Oct 30 11:33:31.735639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.735617    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn" pod "9d432572-86b8-4a37-8cd8-6db47d2ae361" (UID: "9d432572-86b8-4a37-8cd8-6db47d2ae361"). InnerVolumeSpecName "kube-api-access-nc4qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:31.834754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:31.834723    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc4qn\" (UniqueName: \"kubernetes.io/projected/9d432572-86b8-4a37-8cd8-6db47d2ae361-kube-api-access-nc4qn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:32.137333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.137268    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.167241 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.167217    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.237713 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.237693    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.237850 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.237830    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.252794 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.252773    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.270589 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.270567    4488 generic.go:356] "Generic (PLEG): container finished" podID="9d432572-86b8-4a37-8cd8-6db47d2ae361" containerID="81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196" exitCode=0
Oct 30 11:33:32.270687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.270610    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"
Oct 30 11:33:32.270687 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.270654    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" event={"ID":"9d432572-86b8-4a37-8cd8-6db47d2ae361","Type":"ContainerDied","Data":"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"}
Oct 30 11:33:32.270771 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.270694    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh" event={"ID":"9d432572-86b8-4a37-8cd8-6db47d2ae361","Type":"ContainerDied","Data":"1c0c97d1139dddeca5daa01ea63388d400b86f611e618897f11b495cfcb38cbc"}
Oct 30 11:33:32.270771 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.270712    4488 scope.go:122] "RemoveContainer" containerID="81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"
Oct 30 11:33:32.285792 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.285767    4488 scope.go:122] "RemoveContainer" containerID="81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"
Oct 30 11:33:32.286129 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:32.286109    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196\": container with ID starting with 81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196 not found: ID does not exist" containerID="81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"
Oct 30 11:33:32.286197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.286138    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196"} err="failed to get container status \"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196\": rpc error: code = NotFound desc = could not find container \"81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196\": container with ID starting with 81f25ad04818b7b9e320c4671b35e80bf6e6096823000fb2d7a27125f701e196 not found: ID does not exist"
Oct 30 11:33:32.322535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.322513    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:32.325952 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.325923    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7hvgh"]
Oct 30 11:33:32.361877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.361857    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.391291 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.391246    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.506856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.506833    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:32.802487 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:32.802460    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:33:32.805488 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:32.805462    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb1439b4_06db_4792_bce4_8d4dc6886e61.slice/crio-afe36c6104abe3d3390d317ef63d8c7cc9df7b2a78bc1b6c0d79c5136e5d6e77 WatchSource:0}: Error finding container afe36c6104abe3d3390d317ef63d8c7cc9df7b2a78bc1b6c0d79c5136e5d6e77: Status 404 returned error can't find the container with id afe36c6104abe3d3390d317ef63d8c7cc9df7b2a78bc1b6c0d79c5136e5d6e77
Oct 30 11:33:33.278064 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:33.278031    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"db1439b4-06db-4792-bce4-8d4dc6886e61","Type":"ContainerStarted","Data":"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"}
Oct 30 11:33:33.278255 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:33.278085    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:33.278255 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:33.278101    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"db1439b4-06db-4792-bce4-8d4dc6886e61","Type":"ContainerStarted","Data":"afe36c6104abe3d3390d317ef63d8c7cc9df7b2a78bc1b6c0d79c5136e5d6e77"}
Oct 30 11:33:33.319625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:33.319582    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.319569135 podStartE2EDuration="6.319569135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:33.319071653 +0000 UTC m=+2909.664663499" watchObservedRunningTime="2026-10-30 11:33:33.319569135 +0000 UTC m=+2909.665160988"
Oct 30 11:33:33.802868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:33.802834    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d432572-86b8-4a37-8cd8-6db47d2ae361" path="/var/lib/kubelet/pods/9d432572-86b8-4a37-8cd8-6db47d2ae361/volumes"
Oct 30 11:33:44.285253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:44.285226    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:33:46.860989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:46.860914    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:46.861497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:46.861117    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="487de227-212b-42fb-b6ff-5c1bb4d246ca" containerName="otc-container" containerID="cri-o://70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100" gracePeriod=30
Oct 30 11:33:47.072085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.072052    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:33:47.072469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.072451    4488 cpu_manager.go:414] "containerMap: removing container" podUID="9d432572-86b8-4a37-8cd8-6db47d2ae361" containerName="thanos-querier"
Oct 30 11:33:47.072579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.072471    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d432572-86b8-4a37-8cd8-6db47d2ae361" containerName="thanos-querier"
Oct 30 11:33:47.072579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.072544    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d432572-86b8-4a37-8cd8-6db47d2ae361" containerName="thanos-querier"
Oct 30 11:33:47.075599 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.075580    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.097684 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.097661    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:33:47.104833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.104810    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:47.144827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.144768    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\") pod \"487de227-212b-42fb-b6ff-5c1bb4d246ca\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") "
Oct 30 11:33:47.144827 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.144808    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\") pod \"487de227-212b-42fb-b6ff-5c1bb4d246ca\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") "
Oct 30 11:33:47.144993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.144885    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\" (UniqueName: \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\") pod \"487de227-212b-42fb-b6ff-5c1bb4d246ca\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") "
Oct 30 11:33:47.144993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.144936    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\") pod \"487de227-212b-42fb-b6ff-5c1bb4d246ca\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") "
Oct 30 11:33:47.144993 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.144978    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\" (UniqueName: \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\") pod \"487de227-212b-42fb-b6ff-5c1bb4d246ca\" (UID: \"487de227-212b-42fb-b6ff-5c1bb4d246ca\") "
Oct 30 11:33:47.145181 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.145159    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.145244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.145206    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.145318 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.145282    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal" pod "487de227-212b-42fb-b6ff-5c1bb4d246ca" (UID: "487de227-212b-42fb-b6ff-5c1bb4d246ca"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:47.145399 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.145335    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b75hz\" (UniqueName: \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.145466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.145436    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/487de227-212b-42fb-b6ff-5c1bb4d246ca-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:47.146937 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.146907    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx" pod "487de227-212b-42fb-b6ff-5c1bb4d246ca" (UID: "487de227-212b-42fb-b6ff-5c1bb4d246ca"). InnerVolumeSpecName "kube-api-access-2swcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:47.147033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.146970    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert" pod "487de227-212b-42fb-b6ff-5c1bb4d246ca" (UID: "487de227-212b-42fb-b6ff-5c1bb4d246ca"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:47.147033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.146988    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs" pod "487de227-212b-42fb-b6ff-5c1bb4d246ca" (UID: "487de227-212b-42fb-b6ff-5c1bb4d246ca"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:47.147033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.147021    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs" pod "487de227-212b-42fb-b6ff-5c1bb4d246ca" (UID: "487de227-212b-42fb-b6ff-5c1bb4d246ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:47.245790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245764    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b75hz\" (UniqueName: \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245828    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245851    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245878    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245888    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2swcx\" (UniqueName: \"kubernetes.io/projected/487de227-212b-42fb-b6ff-5c1bb4d246ca-kube-api-access-2swcx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245896    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:47.245908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.245905    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/487de227-212b-42fb-b6ff-5c1bb4d246ca-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:47.246493 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.246475    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.248074 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.248056    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.269398 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.269380    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b75hz\" (UniqueName: \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\") pod \"data-science-collector-targetallocator-7cf46cb959-hlzdv\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.334940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.334918    4488 generic.go:356] "Generic (PLEG): container finished" podID="487de227-212b-42fb-b6ff-5c1bb4d246ca" containerID="70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100" exitCode=0
Oct 30 11:33:47.335060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.334973    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:33:47.335060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.334998    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"487de227-212b-42fb-b6ff-5c1bb4d246ca","Type":"ContainerDied","Data":"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"}
Oct 30 11:33:47.335060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.335047    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"487de227-212b-42fb-b6ff-5c1bb4d246ca","Type":"ContainerDied","Data":"26d4225892ce5523260f0233a0797563ef39684a9581b1cdd7e093d5d27ad031"}
Oct 30 11:33:47.335235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.335067    4488 scope.go:122] "RemoveContainer" containerID="70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"
Oct 30 11:33:47.343421 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.343396    4488 scope.go:122] "RemoveContainer" containerID="70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"
Oct 30 11:33:47.343672 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:47.343654    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100\": container with ID starting with 70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100 not found: ID does not exist" containerID="70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"
Oct 30 11:33:47.343740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.343683    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100"} err="failed to get container status \"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100\": rpc error: code = NotFound desc = could not find container \"70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100\": container with ID starting with 70455df702642aa216fe8f96383c3013d3688f0cdba6c064ed1963689b426100 not found: ID does not exist"
Oct 30 11:33:47.386886 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.386826    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:47.391045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.391015    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:33:47.400883 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.400829    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:47.697309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.697277    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:33:47.700674 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:47.700651    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46677d2e_6fbe_4583_ac9a_e3c1d8b471d5.slice/crio-3af4c2bf09ad5aa56753b6c5aeadfcf6c482a1352a69a33f2df1736b7e5eebe0 WatchSource:0}: Error finding container 3af4c2bf09ad5aa56753b6c5aeadfcf6c482a1352a69a33f2df1736b7e5eebe0: Status 404 returned error can't find the container with id 3af4c2bf09ad5aa56753b6c5aeadfcf6c482a1352a69a33f2df1736b7e5eebe0
Oct 30 11:33:47.702776 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.702744    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:47.702877 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.702820    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:47.802568 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:47.802535    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="487de227-212b-42fb-b6ff-5c1bb4d246ca" path="/var/lib/kubelet/pods/487de227-212b-42fb-b6ff-5c1bb4d246ca/volumes"
Oct 30 11:33:48.341168 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.341136    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" event={"ID":"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5","Type":"ContainerStarted","Data":"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"}
Oct 30 11:33:48.341566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.341175    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" event={"ID":"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5","Type":"ContainerStarted","Data":"3af4c2bf09ad5aa56753b6c5aeadfcf6c482a1352a69a33f2df1736b7e5eebe0"}
Oct 30 11:33:48.341566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.341401    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:48.342953 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.342934    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:48.383692 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.383656    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" podStartSLOduration=1.383644845 podStartE2EDuration="1.383644845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:48.383043674 +0000 UTC m=+2924.728635529" watchObservedRunningTime="2026-10-30 11:33:48.383644845 +0000 UTC m=+2924.729236698"
Oct 30 11:33:48.457525 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.457501    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:48.457707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.457684    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" podUID="5934da53-a565-4562-9ebb-b8eb3471de6a" containerName="ta-container" containerID="cri-o://a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb" gracePeriod=30
Oct 30 11:33:48.702562 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.702530    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:48.758676 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.758639    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\" (UniqueName: \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\") pod \"5934da53-a565-4562-9ebb-b8eb3471de6a\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") "
Oct 30 11:33:48.758811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.758731    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\") pod \"5934da53-a565-4562-9ebb-b8eb3471de6a\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") "
Oct 30 11:33:48.758811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.758798    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\") pod \"5934da53-a565-4562-9ebb-b8eb3471de6a\" (UID: \"5934da53-a565-4562-9ebb-b8eb3471de6a\") "
Oct 30 11:33:48.759162 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.759134    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal" pod "5934da53-a565-4562-9ebb-b8eb3471de6a" (UID: "5934da53-a565-4562-9ebb-b8eb3471de6a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:48.760943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.760920    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b" pod "5934da53-a565-4562-9ebb-b8eb3471de6a" (UID: "5934da53-a565-4562-9ebb-b8eb3471de6a"). InnerVolumeSpecName "kube-api-access-jh54b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:48.761056 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.760953    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert" pod "5934da53-a565-4562-9ebb-b8eb3471de6a" (UID: "5934da53-a565-4562-9ebb-b8eb3471de6a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:48.859716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.859686    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5934da53-a565-4562-9ebb-b8eb3471de6a-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:48.859716 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.859712    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5934da53-a565-4562-9ebb-b8eb3471de6a-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:48.859882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:48.859723    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh54b\" (UniqueName: \"kubernetes.io/projected/5934da53-a565-4562-9ebb-b8eb3471de6a-kube-api-access-jh54b\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:49.345919 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.345886    4488 generic.go:356] "Generic (PLEG): container finished" podID="5934da53-a565-4562-9ebb-b8eb3471de6a" containerID="a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb" exitCode=0
Oct 30 11:33:49.346405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.345927    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"
Oct 30 11:33:49.346405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.345960    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" event={"ID":"5934da53-a565-4562-9ebb-b8eb3471de6a","Type":"ContainerDied","Data":"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"}
Oct 30 11:33:49.346405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.345998    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c" event={"ID":"5934da53-a565-4562-9ebb-b8eb3471de6a","Type":"ContainerDied","Data":"4ea01201c977a105752403c7b54f0fe2adf08706e866f019979de12f33bed4d2"}
Oct 30 11:33:49.346405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.346023    4488 scope.go:122] "RemoveContainer" containerID="a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"
Oct 30 11:33:49.354260 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.354244    4488 scope.go:122] "RemoveContainer" containerID="a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"
Oct 30 11:33:49.354572 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:33:49.354544    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb\": container with ID starting with a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb not found: ID does not exist" containerID="a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"
Oct 30 11:33:49.354629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.354580    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb"} err="failed to get container status \"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb\": rpc error: code = NotFound desc = could not find container \"a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb\": container with ID starting with a09eac5e5d9684f7287851f6deb6411bea48ee8dcaf9c7a5500dbf71d2e415cb not found: ID does not exist"
Oct 30 11:33:49.397281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.397257    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:49.410286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.410266    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799f9b6858-mg94c"]
Oct 30 11:33:49.803096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:49.803064    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5934da53-a565-4562-9ebb-b8eb3471de6a" path="/var/lib/kubelet/pods/5934da53-a565-4562-9ebb-b8eb3471de6a/volumes"
Oct 30 11:33:57.450385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450324    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450641    4488 cpu_manager.go:414] "containerMap: removing container" podUID="487de227-212b-42fb-b6ff-5c1bb4d246ca" containerName="otc-container"
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450653    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="487de227-212b-42fb-b6ff-5c1bb4d246ca" containerName="otc-container"
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450669    4488 cpu_manager.go:414] "containerMap: removing container" podUID="5934da53-a565-4562-9ebb-b8eb3471de6a" containerName="ta-container"
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450674    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5934da53-a565-4562-9ebb-b8eb3471de6a" containerName="ta-container"
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450726    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="487de227-212b-42fb-b6ff-5c1bb4d246ca" containerName="otc-container"
Oct 30 11:33:57.450786 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.450736    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="5934da53-a565-4562-9ebb-b8eb3471de6a" containerName="ta-container"
Oct 30 11:33:57.454678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.454659    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.472095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.472070    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:33:57.518363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.518321    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.518477 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.518376    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.518519 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.518491    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdncf\" (UniqueName: \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.619298 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.619263    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.619476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.619305    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.619476 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.619330    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdncf\" (UniqueName: \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.619977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.619949    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.621791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.621770    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.643175 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.643151    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdncf\" (UniqueName: \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\") pod \"data-science-collector-targetallocator-57cbd7cd76-bcw8b\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:57.768037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:57.767982    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:58.064568 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.064488    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:33:58.068110 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:33:58.068076    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18900c06_81b4_4639_bd83_09efa09bd4a7.slice/crio-e4762e852e76a52ca9fc2a3cf92fa4a4d80084f030179ac77c1e26afcf243829 WatchSource:0}: Error finding container e4762e852e76a52ca9fc2a3cf92fa4a4d80084f030179ac77c1e26afcf243829: Status 404 returned error can't find the container with id e4762e852e76a52ca9fc2a3cf92fa4a4d80084f030179ac77c1e26afcf243829
Oct 30 11:33:58.070224 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.070193    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:58.070350 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.070253    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:33:58.387686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.387598    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" event={"ID":"18900c06-81b4-4639-bd83-09efa09bd4a7","Type":"ContainerStarted","Data":"fca4e3ad8431c53d88f22929b87fbac101d01ce2e901427c20d57dc2b1efc984"}
Oct 30 11:33:58.387686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.387643    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" event={"ID":"18900c06-81b4-4639-bd83-09efa09bd4a7","Type":"ContainerStarted","Data":"e4762e852e76a52ca9fc2a3cf92fa4a4d80084f030179ac77c1e26afcf243829"}
Oct 30 11:33:58.387926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.387764    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:58.388530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.388505    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.181:8080/readyz\": dial tcp 10.133.0.181:8080: connect: connection refused"
Oct 30 11:33:58.430323 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:58.430279    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" podStartSLOduration=1.430267657 podStartE2EDuration="1.430267657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:33:58.429260431 +0000 UTC m=+2934.774852287" watchObservedRunningTime="2026-10-30 11:33:58.430267657 +0000 UTC m=+2934.775859510"
Oct 30 11:33:59.393796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.393765    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:33:59.463395 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.463360    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:33:59.463569 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.463518    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" podUID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" containerName="ta-container" containerID="cri-o://292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37" gracePeriod=30
Oct 30 11:33:59.698706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.698683    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:33:59.736481 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.736454    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\" (UniqueName: \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\") pod \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") "
Oct 30 11:33:59.736577 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.736493    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\" (UniqueName: \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\") pod \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") "
Oct 30 11:33:59.736577 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.736531    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\") pod \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\" (UID: \"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5\") "
Oct 30 11:33:59.736852 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.736831    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal" pod "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" (UID: "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:33:59.738492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.738470    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz" pod "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" (UID: "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5"). InnerVolumeSpecName "kube-api-access-b75hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:33:59.738575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.738517    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert" pod "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" (UID: "46677d2e-6fbe-4583-ac9a-e3c1d8b471d5"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:33:59.837631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.837606    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b75hz\" (UniqueName: \"kubernetes.io/projected/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-kube-api-access-b75hz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:59.837631 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.837628    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:33:59.837778 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:33:59.837638    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:00.398068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.398036    4488 generic.go:356] "Generic (PLEG): container finished" podID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" containerID="292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37" exitCode=0
Oct 30 11:34:00.398469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.398076    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"
Oct 30 11:34:00.398469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.398119    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" event={"ID":"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5","Type":"ContainerDied","Data":"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"}
Oct 30 11:34:00.398469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.398154    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv" event={"ID":"46677d2e-6fbe-4583-ac9a-e3c1d8b471d5","Type":"ContainerDied","Data":"3af4c2bf09ad5aa56753b6c5aeadfcf6c482a1352a69a33f2df1736b7e5eebe0"}
Oct 30 11:34:00.398469 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.398170    4488 scope.go:122] "RemoveContainer" containerID="292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"
Oct 30 11:34:00.406029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.406011    4488 scope.go:122] "RemoveContainer" containerID="292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"
Oct 30 11:34:00.406291 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:00.406273    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37\": container with ID starting with 292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37 not found: ID does not exist" containerID="292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"
Oct 30 11:34:00.406333 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.406300    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37"} err="failed to get container status \"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37\": rpc error: code = NotFound desc = could not find container \"292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37\": container with ID starting with 292aac7e0d77b9ad6f1f6a05ec62f4183d3cfbca3070bcbdf82734e580e7bd37 not found: ID does not exist"
Oct 30 11:34:00.450028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.450005    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:34:00.462938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:00.462916    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7cf46cb959-hlzdv"]
Oct 30 11:34:01.391874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.391638    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:34:01.391874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.391860    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" podUID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" containerName="thanos-querier" containerID="cri-o://3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1" gracePeriod=30
Oct 30 11:34:01.440707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.440680    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"]
Oct 30 11:34:01.441067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.440989    4488 cpu_manager.go:414] "containerMap: removing container" podUID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" containerName="ta-container"
Oct 30 11:34:01.441067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.441002    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" containerName="ta-container"
Oct 30 11:34:01.441067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.441057    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" containerName="ta-container"
Oct 30 11:34:01.444312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.444286    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:01.457821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.457800    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"]
Oct 30 11:34:01.474182 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:01.474154    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fkzd6], unattached volumes=[], failed to process volumes=[kube-api-access-fkzd6]: context canceled" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d" podUID="3a3592a9-c756-4d54-a403-8eb48616f36b"
Oct 30 11:34:01.485126 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:01.485080    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:34:01.519972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.519943    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"]
Oct 30 11:34:01.551915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.551880    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkzd6\" (UniqueName: \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-b799d\" (UID: \"3a3592a9-c756-4d54-a403-8eb48616f36b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:01.643833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.643777    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:34:01.652920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.652898    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkzd6\" (UniqueName: \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-b799d\" (UID: \"3a3592a9-c756-4d54-a403-8eb48616f36b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:01.677070 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.677039    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkzd6\" (UniqueName: \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-b799d\" (UID: \"3a3592a9-c756-4d54-a403-8eb48616f36b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:01.753943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.753915    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\" (UniqueName: \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\") pod \"25a5a33a-64f8-4f23-8869-8d5c7de159e6\" (UID: \"25a5a33a-64f8-4f23-8869-8d5c7de159e6\") "
Oct 30 11:34:01.755925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.755902    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6" pod "25a5a33a-64f8-4f23-8869-8d5c7de159e6" (UID: "25a5a33a-64f8-4f23-8869-8d5c7de159e6"). InnerVolumeSpecName "kube-api-access-rhng6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:01.802269 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.802239    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46677d2e-6fbe-4583-ac9a-e3c1d8b471d5" path="/var/lib/kubelet/pods/46677d2e-6fbe-4583-ac9a-e3c1d8b471d5/volumes"
Oct 30 11:34:01.854621 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:01.854595    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhng6\" (UniqueName: \"kubernetes.io/projected/25a5a33a-64f8-4f23-8869-8d5c7de159e6-kube-api-access-rhng6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.214415 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.214372    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:34:02.214616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.214590    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerName="ta-container" containerID="cri-o://fca4e3ad8431c53d88f22929b87fbac101d01ce2e901427c20d57dc2b1efc984" gracePeriod=30
Oct 30 11:34:02.329501 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.329470    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:02.329677 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.329649    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="db1439b4-06db-4792-bce4-8d4dc6886e61" containerName="perses" containerID="cri-o://6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115" gracePeriod=30
Oct 30 11:34:02.410785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.410758    4488 generic.go:356] "Generic (PLEG): container finished" podID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerID="fca4e3ad8431c53d88f22929b87fbac101d01ce2e901427c20d57dc2b1efc984" exitCode=0
Oct 30 11:34:02.410917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.410837    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" event={"ID":"18900c06-81b4-4639-bd83-09efa09bd4a7","Type":"ContainerDied","Data":"fca4e3ad8431c53d88f22929b87fbac101d01ce2e901427c20d57dc2b1efc984"}
Oct 30 11:34:02.412174 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412153    4488 generic.go:356] "Generic (PLEG): container finished" podID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" containerID="3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1" exitCode=0
Oct 30 11:34:02.412262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412222    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:02.412262 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412235    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"
Oct 30 11:34:02.412367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412261    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" event={"ID":"25a5a33a-64f8-4f23-8869-8d5c7de159e6","Type":"ContainerDied","Data":"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"}
Oct 30 11:34:02.412367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412306    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c" event={"ID":"25a5a33a-64f8-4f23-8869-8d5c7de159e6","Type":"ContainerDied","Data":"d43020c39deb17ca93159154f2fff1ac3dfea9c6c8aabdaa54aad8db04004979"}
Oct 30 11:34:02.412367 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.412326    4488 scope.go:122] "RemoveContainer" containerID="3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"
Oct 30 11:34:02.421001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.420985    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:02.440905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.440864    4488 scope.go:122] "RemoveContainer" containerID="3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"
Oct 30 11:34:02.441300 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:02.441143    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1\": container with ID starting with 3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1 not found: ID does not exist" containerID="3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"
Oct 30 11:34:02.441300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.441266    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1"} err="failed to get container status \"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1\": rpc error: code = NotFound desc = could not find container \"3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1\": container with ID starting with 3f1cbbfcf28e93a04f7dfaa6f7df33842f379bc867838e5dd6ae87633a3acec1 not found: ID does not exist"
Oct 30 11:34:02.459632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.459599    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\" (UniqueName: \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\") pod \"3a3592a9-c756-4d54-a403-8eb48616f36b\" (UID: \"3a3592a9-c756-4d54-a403-8eb48616f36b\") "
Oct 30 11:34:02.461756 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.461734    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6" pod "3a3592a9-c756-4d54-a403-8eb48616f36b" (UID: "3a3592a9-c756-4d54-a403-8eb48616f36b"). InnerVolumeSpecName "kube-api-access-fkzd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:02.471934 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.471914    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:34:02.524653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.524625    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:34:02.528943 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.528918    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-8ks7c"]
Oct 30 11:34:02.560233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.560209    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\") pod \"18900c06-81b4-4639-bd83-09efa09bd4a7\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") "
Oct 30 11:34:02.560383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.560271    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\" (UniqueName: \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\") pod \"18900c06-81b4-4639-bd83-09efa09bd4a7\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") "
Oct 30 11:34:02.560383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.560374    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\" (UniqueName: \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\") pod \"18900c06-81b4-4639-bd83-09efa09bd4a7\" (UID: \"18900c06-81b4-4639-bd83-09efa09bd4a7\") "
Oct 30 11:34:02.560623 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.560603    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkzd6\" (UniqueName: \"kubernetes.io/projected/3a3592a9-c756-4d54-a403-8eb48616f36b-kube-api-access-fkzd6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.560740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.560717    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal" pod "18900c06-81b4-4639-bd83-09efa09bd4a7" (UID: "18900c06-81b4-4639-bd83-09efa09bd4a7"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:02.563949 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.563929    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf" pod "18900c06-81b4-4639-bd83-09efa09bd4a7" (UID: "18900c06-81b4-4639-bd83-09efa09bd4a7"). InnerVolumeSpecName "kube-api-access-gdncf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:02.564025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.563978    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert" pod "18900c06-81b4-4639-bd83-09efa09bd4a7" (UID: "18900c06-81b4-4639-bd83-09efa09bd4a7"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:02.587223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.587201    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:02.661570 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661548    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"db1439b4-06db-4792-bce4-8d4dc6886e61\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") "
Oct 30 11:34:02.661706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661593    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\" (UniqueName: \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\") pod \"db1439b4-06db-4792-bce4-8d4dc6886e61\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") "
Oct 30 11:34:02.661706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661624    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\" (UniqueName: \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\") pod \"db1439b4-06db-4792-bce4-8d4dc6886e61\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") "
Oct 30 11:34:02.661706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661649    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\" (UniqueName: \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\") pod \"db1439b4-06db-4792-bce4-8d4dc6886e61\" (UID: \"db1439b4-06db-4792-bce4-8d4dc6886e61\") "
Oct 30 11:34:02.661880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661786    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/18900c06-81b4-4639-bd83-09efa09bd4a7-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.661880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661797    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdncf\" (UniqueName: \"kubernetes.io/projected/18900c06-81b4-4639-bd83-09efa09bd4a7-kube-api-access-gdncf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.661880 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.661807    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/18900c06-81b4-4639-bd83-09efa09bd4a7-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.662045 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.662013    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config" pod "db1439b4-06db-4792-bce4-8d4dc6886e61" (UID: "db1439b4-06db-4792-bce4-8d4dc6886e61"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:02.663842 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.663819    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn" pod "db1439b4-06db-4792-bce4-8d4dc6886e61" (UID: "db1439b4-06db-4792-bce4-8d4dc6886e61"). InnerVolumeSpecName "kube-api-access-d2drn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:02.663977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.663961    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "db1439b4-06db-4792-bce4-8d4dc6886e61" (UID: "db1439b4-06db-4792-bce4-8d4dc6886e61"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:34:02.762981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.762917    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2drn\" (UniqueName: \"kubernetes.io/projected/db1439b4-06db-4792-bce4-8d4dc6886e61-kube-api-access-d2drn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.762981 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.762969    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:34:02.763118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.762986    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db1439b4-06db-4792-bce4-8d4dc6886e61-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.776603 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.776587    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:34:02.810411 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.810377    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins" pod "db1439b4-06db-4792-bce4-8d4dc6886e61" (UID: "db1439b4-06db-4792-bce4-8d4dc6886e61"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:34:02.863316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.863291    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/db1439b4-06db-4792-bce4-8d4dc6886e61-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:02.863316 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:02.863315    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:34:03.418394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.418368    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"
Oct 30 11:34:03.418515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.418394    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b" event={"ID":"18900c06-81b4-4639-bd83-09efa09bd4a7","Type":"ContainerDied","Data":"e4762e852e76a52ca9fc2a3cf92fa4a4d80084f030179ac77c1e26afcf243829"}
Oct 30 11:34:03.418515 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.418442    4488 scope.go:122] "RemoveContainer" containerID="fca4e3ad8431c53d88f22929b87fbac101d01ce2e901427c20d57dc2b1efc984"
Oct 30 11:34:03.420825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.420799    4488 generic.go:356] "Generic (PLEG): container finished" podID="db1439b4-06db-4792-bce4-8d4dc6886e61" containerID="6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115" exitCode=0
Oct 30 11:34:03.420938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.420833    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:03.420938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.420854    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"
Oct 30 11:34:03.420938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.420881    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"db1439b4-06db-4792-bce4-8d4dc6886e61","Type":"ContainerDied","Data":"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"}
Oct 30 11:34:03.420938 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.420917    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"db1439b4-06db-4792-bce4-8d4dc6886e61","Type":"ContainerDied","Data":"afe36c6104abe3d3390d317ef63d8c7cc9df7b2a78bc1b6c0d79c5136e5d6e77"}
Oct 30 11:34:03.426703 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.426685    4488 scope.go:122] "RemoveContainer" containerID="6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"
Oct 30 11:34:03.435183 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.435168    4488 scope.go:122] "RemoveContainer" containerID="6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"
Oct 30 11:34:03.435474 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:03.435453    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115\": container with ID starting with 6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115 not found: ID does not exist" containerID="6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"
Oct 30 11:34:03.435558 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.435480    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115"} err="failed to get container status \"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115\": rpc error: code = NotFound desc = could not find container \"6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115\": container with ID starting with 6bc54b5c43d2c6897d9a596e3308f75a6e5c5a47abb1287b8d7e4ad7096f1115 not found: ID does not exist"
Oct 30 11:34:03.472689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.472669    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:34:03.476114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.476092    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57cbd7cd76-bcw8b"]
Oct 30 11:34:03.510744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.510721    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:03.514642 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.514626    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:03.574489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.574466    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"]
Oct 30 11:34:03.578690 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.578669    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-b799d"]
Oct 30 11:34:03.802751 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.802730    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" path="/var/lib/kubelet/pods/18900c06-81b4-4639-bd83-09efa09bd4a7/volumes"
Oct 30 11:34:03.803038 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.803025    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" path="/var/lib/kubelet/pods/25a5a33a-64f8-4f23-8869-8d5c7de159e6/volumes"
Oct 30 11:34:03.803301 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.803290    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a3592a9-c756-4d54-a403-8eb48616f36b" path="/var/lib/kubelet/pods/3a3592a9-c756-4d54-a403-8eb48616f36b/volumes"
Oct 30 11:34:03.803668 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:03.803654    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db1439b4-06db-4792-bce4-8d4dc6886e61" path="/var/lib/kubelet/pods/db1439b4-06db-4792-bce4-8d4dc6886e61/volumes"
Oct 30 11:34:07.152813 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.152780    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:07.153302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153281    4488 cpu_manager.go:414] "containerMap: removing container" podUID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" containerName="thanos-querier"
Oct 30 11:34:07.153361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153307    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" containerName="thanos-querier"
Oct 30 11:34:07.153361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153334    4488 cpu_manager.go:414] "containerMap: removing container" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerName="ta-container"
Oct 30 11:34:07.153435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153360    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerName="ta-container"
Oct 30 11:34:07.153435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153381    4488 cpu_manager.go:414] "containerMap: removing container" podUID="db1439b4-06db-4792-bce4-8d4dc6886e61" containerName="perses"
Oct 30 11:34:07.153435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153389    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db1439b4-06db-4792-bce4-8d4dc6886e61" containerName="perses"
Oct 30 11:34:07.153527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153487    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="db1439b4-06db-4792-bce4-8d4dc6886e61" containerName="perses"
Oct 30 11:34:07.153527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153505    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="25a5a33a-64f8-4f23-8869-8d5c7de159e6" containerName="thanos-querier"
Oct 30 11:34:07.153527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.153518    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="18900c06-81b4-4639-bd83-09efa09bd4a7" containerName="ta-container"
Oct 30 11:34:07.158454 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.158434    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:07.173731 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.173704    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:07.175671 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.175645    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:34:07.185708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.185688    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:34:07.188426 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.188410    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:34:07.196366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.196324    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9jz\" (UniqueName: \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf\" (UID: \"bb3962d0-9481-4f9c-9052-7b37209b6368\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:07.297675 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.297649    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9jz\" (UniqueName: \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf\" (UID: \"bb3962d0-9481-4f9c-9052-7b37209b6368\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:07.323888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.323859    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9jz\" (UniqueName: \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf\" (UID: \"bb3962d0-9481-4f9c-9052-7b37209b6368\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:07.471125 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.471099    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:07.762821 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:07.762742    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:07.766778 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:07.766748    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb3962d0_9481_4f9c_9052_7b37209b6368.slice/crio-e1018c00f56eb13d90288727f787a7d9ba7e29df3a79524a176730115f024083 WatchSource:0}: Error finding container e1018c00f56eb13d90288727f787a7d9ba7e29df3a79524a176730115f024083: Status 404 returned error can't find the container with id e1018c00f56eb13d90288727f787a7d9ba7e29df3a79524a176730115f024083
Oct 30 11:34:08.196244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.196214    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:08.200980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.200947    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.252364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.252313    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:08.255829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.255808    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:08.255922 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.255892    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.263292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.263267    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:34:08.263423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.263368    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:34:08.263423 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.263369    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:34:08.263554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.263448    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-phltc\""
Oct 30 11:34:08.263839 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.263820    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:34:08.279490 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.279458    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:08.296548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.296495    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:08.299674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.299655    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.304517 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.304497    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.304638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.304546    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.304638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.304566    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787rz\" (UniqueName: \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.304781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.304761    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.304844 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.304813    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.319928 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.319904    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:08.350638 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.350615    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-j5ksl\""
Oct 30 11:34:08.350726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.350666    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:34:08.351058 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.351043    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:34:08.351133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.351120    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:34:08.405557 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405535    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.405647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405568    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.405647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405593    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.405647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405611    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787rz\" (UniqueName: \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.405785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405667    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxzk\" (UniqueName: \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.405785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405694    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.405785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405745    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.405785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.405767    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.406400 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.406371    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.407977 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.407953    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.408186 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.408166    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.408253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.408223    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.429135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.429115    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-787rz\" (UniqueName: \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\") pod \"data-science-collector-collector-1\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.442632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.442612    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" event={"ID":"bb3962d0-9481-4f9c-9052-7b37209b6368","Type":"ContainerStarted","Data":"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"}
Oct 30 11:34:08.442707 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.442640    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" event={"ID":"bb3962d0-9481-4f9c-9052-7b37209b6368","Type":"ContainerStarted","Data":"e1018c00f56eb13d90288727f787a7d9ba7e29df3a79524a176730115f024083"}
Oct 30 11:34:08.484547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.484482    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" podStartSLOduration=1.484472098 podStartE2EDuration="1.484472098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:08.483921753 +0000 UTC m=+2944.829513603" watchObservedRunningTime="2026-10-30 11:34:08.484472098 +0000 UTC m=+2944.830063952"
Oct 30 11:34:08.506468 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506442    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9drw\" (UniqueName: \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.506553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506477    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.506553 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506507    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.506647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506623    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.506717 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506702    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxzk\" (UniqueName: \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.506761 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506726    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.507015 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.506995    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.507233 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.507218    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.521488 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.521469    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:08.530763 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.530740    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxzk\" (UniqueName: \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:08.607823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.607794    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9drw\" (UniqueName: \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.607976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.607832    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.607976 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.607860    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.608471 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.608449    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.610103 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.610080    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.631700 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.631681    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9drw\" (UniqueName: \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\") pod \"data-science-collector-targetallocator-545ff9b486-nb7s2\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:08.819551 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.819490    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:08.822790 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:08.822768    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1898a8_59f1_4c23_84b6_9f9f4ce05ff4.slice/crio-0bb38d93e4e17a7bcd948e5bbb6aebb7a6b4468f9a829a56e311a414364d6f26 WatchSource:0}: Error finding container 0bb38d93e4e17a7bcd948e5bbb6aebb7a6b4468f9a829a56e311a414364d6f26: Status 404 returned error can't find the container with id 0bb38d93e4e17a7bcd948e5bbb6aebb7a6b4468f9a829a56e311a414364d6f26
Oct 30 11:34:08.824876 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.824847    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:08.824939 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.824903    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:08.910762 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:08.910727    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:09.212466 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.212436    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:09.215788 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:09.215761    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda82e09c9_b7a4_4827_80ae_fa104d70ff59.slice/crio-d905cb78f930b9c1d35dc93325f07aa34aa7e96238c3007a607e2b4715846fb0 WatchSource:0}: Error finding container d905cb78f930b9c1d35dc93325f07aa34aa7e96238c3007a607e2b4715846fb0: Status 404 returned error can't find the container with id d905cb78f930b9c1d35dc93325f07aa34aa7e96238c3007a607e2b4715846fb0
Oct 30 11:34:09.218107 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.218075    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:09.218210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.218130    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:09.448834 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.448791    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" event={"ID":"a82e09c9-b7a4-4827-80ae-fa104d70ff59","Type":"ContainerStarted","Data":"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"}
Oct 30 11:34:09.448997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.448850    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" event={"ID":"a82e09c9-b7a4-4827-80ae-fa104d70ff59","Type":"ContainerStarted","Data":"d905cb78f930b9c1d35dc93325f07aa34aa7e96238c3007a607e2b4715846fb0"}
Oct 30 11:34:09.448997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.448879    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:09.450048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.450021    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.187:8080/readyz\": dial tcp 10.133.0.187:8080: connect: connection refused"
Oct 30 11:34:09.450396 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.450363    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4","Type":"ContainerStarted","Data":"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"}
Oct 30 11:34:09.450464 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.450455    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4","Type":"ContainerStarted","Data":"0bb38d93e4e17a7bcd948e5bbb6aebb7a6b4468f9a829a56e311a414364d6f26"}
Oct 30 11:34:09.492101 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.492025    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" podStartSLOduration=1.492013034 podStartE2EDuration="1.492013034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:09.4911375 +0000 UTC m=+2945.836729357" watchObservedRunningTime="2026-10-30 11:34:09.492013034 +0000 UTC m=+2945.837604916"
Oct 30 11:34:09.536921 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:09.536884    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.536873351 podStartE2EDuration="1.536873351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:09.535885776 +0000 UTC m=+2945.881477623" watchObservedRunningTime="2026-10-30 11:34:09.536873351 +0000 UTC m=+2945.882465205"
Oct 30 11:34:10.456683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.456662    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:10.682334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.682301    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:10.685710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.685692    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:10.701966 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.701941    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:10.828352 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.828322    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nt5s\" (UniqueName: \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb\" (UID: \"8b52421f-7d10-4d60-803e-707ed22633cf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:10.928961 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.928932    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt5s\" (UniqueName: \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb\" (UID: \"8b52421f-7d10-4d60-803e-707ed22633cf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:10.952634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.952580    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt5s\" (UniqueName: \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb\" (UID: \"8b52421f-7d10-4d60-803e-707ed22633cf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:10.997436 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:10.997412    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:11.291959 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.291890    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:11.295732 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:11.295694    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b52421f_7d10_4d60_803e_707ed22633cf.slice/crio-486e640ed3c3250a144ddb190fb0a37484626b579aae482ef6f85a8b3d05a6a9 WatchSource:0}: Error finding container 486e640ed3c3250a144ddb190fb0a37484626b579aae482ef6f85a8b3d05a6a9: Status 404 returned error can't find the container with id 486e640ed3c3250a144ddb190fb0a37484626b579aae482ef6f85a8b3d05a6a9
Oct 30 11:34:11.461691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.461650    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" event={"ID":"8b52421f-7d10-4d60-803e-707ed22633cf","Type":"ContainerStarted","Data":"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"}
Oct 30 11:34:11.462182 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.461700    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" event={"ID":"8b52421f-7d10-4d60-803e-707ed22633cf","Type":"ContainerStarted","Data":"486e640ed3c3250a144ddb190fb0a37484626b579aae482ef6f85a8b3d05a6a9"}
Oct 30 11:34:11.502785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.502735    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" podStartSLOduration=1.502722085 podStartE2EDuration="1.502722085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:11.502138823 +0000 UTC m=+2947.847730677" watchObservedRunningTime="2026-10-30 11:34:11.502722085 +0000 UTC m=+2947.848313938"
Oct 30 11:34:11.533504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.533472    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:11.533816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.533675    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" podUID="bb3962d0-9481-4f9c-9052-7b37209b6368" containerName="thanos-querier" containerID="cri-o://8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c" gracePeriod=30
Oct 30 11:34:11.765766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.765739    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:11.937822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.937795    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\" (UniqueName: \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\") pod \"bb3962d0-9481-4f9c-9052-7b37209b6368\" (UID: \"bb3962d0-9481-4f9c-9052-7b37209b6368\") "
Oct 30 11:34:11.939715 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:11.939694    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz" pod "bb3962d0-9481-4f9c-9052-7b37209b6368" (UID: "bb3962d0-9481-4f9c-9052-7b37209b6368"). InnerVolumeSpecName "kube-api-access-jv9jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:12.039195 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.039168    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv9jz\" (UniqueName: \"kubernetes.io/projected/bb3962d0-9481-4f9c-9052-7b37209b6368-kube-api-access-jv9jz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:12.466517 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.466488    4488 generic.go:356] "Generic (PLEG): container finished" podID="bb3962d0-9481-4f9c-9052-7b37209b6368" containerID="8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c" exitCode=0
Oct 30 11:34:12.466905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.466533    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"
Oct 30 11:34:12.466905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.466563    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" event={"ID":"bb3962d0-9481-4f9c-9052-7b37209b6368","Type":"ContainerDied","Data":"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"}
Oct 30 11:34:12.466905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.466599    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf" event={"ID":"bb3962d0-9481-4f9c-9052-7b37209b6368","Type":"ContainerDied","Data":"e1018c00f56eb13d90288727f787a7d9ba7e29df3a79524a176730115f024083"}
Oct 30 11:34:12.466905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.466617    4488 scope.go:122] "RemoveContainer" containerID="8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"
Oct 30 11:34:12.474913 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.474899    4488 scope.go:122] "RemoveContainer" containerID="8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"
Oct 30 11:34:12.475192 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:12.475175    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c\": container with ID starting with 8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c not found: ID does not exist" containerID="8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"
Oct 30 11:34:12.475234 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.475202    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c"} err="failed to get container status \"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c\": rpc error: code = NotFound desc = could not find container \"8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c\": container with ID starting with 8c183e9e4b4aaa7f7cbfe70e2066e8601ff401ef4e804c7a90b80cc640fa654c not found: ID does not exist"
Oct 30 11:34:12.519584 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.519552    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:12.531075 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:12.531054    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-dp4jf"]
Oct 30 11:34:13.348829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.348800    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.379444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.379419    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.449930 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.449905    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.450054 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.450035    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.464960 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.464939    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.565492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.565468    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.597409 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.597384    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.670139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.670116    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:13.803148 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.803116    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb3962d0-9481-4f9c-9052-7b37209b6368" path="/var/lib/kubelet/pods/bb3962d0-9481-4f9c-9052-7b37209b6368/volumes"
Oct 30 11:34:13.963868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:13.963804    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:13.966967 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:13.966935    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ac4cb46_910d_4bd0_880b_0d4823af1c46.slice/crio-fbb971dfd8e1b50adac3a2e3ebb503fa845c444339d4323fecdaeb666a40a445 WatchSource:0}: Error finding container fbb971dfd8e1b50adac3a2e3ebb503fa845c444339d4323fecdaeb666a40a445: Status 404 returned error can't find the container with id fbb971dfd8e1b50adac3a2e3ebb503fa845c444339d4323fecdaeb666a40a445
Oct 30 11:34:14.476861 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:14.476821    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"0ac4cb46-910d-4bd0-880b-0d4823af1c46","Type":"ContainerStarted","Data":"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"}
Oct 30 11:34:14.477025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:14.476873    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"0ac4cb46-910d-4bd0-880b-0d4823af1c46","Type":"ContainerStarted","Data":"fbb971dfd8e1b50adac3a2e3ebb503fa845c444339d4323fecdaeb666a40a445"}
Oct 30 11:34:14.477025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:14.476944    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:14.519561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:14.519507    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.519489588 podStartE2EDuration="6.519489588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:14.518522964 +0000 UTC m=+2950.864114836" watchObservedRunningTime="2026-10-30 11:34:14.519489588 +0000 UTC m=+2950.865081443"
Oct 30 11:34:25.488205 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:25.488176    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:27.277152 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.277120    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:27.277651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.277372    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" containerName="otc-container" containerID="cri-o://bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da" gracePeriod=30
Oct 30 11:34:27.491889 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.491858    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:27.492212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.492195    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bb3962d0-9481-4f9c-9052-7b37209b6368" containerName="thanos-querier"
Oct 30 11:34:27.492212 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.492212    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb3962d0-9481-4f9c-9052-7b37209b6368" containerName="thanos-querier"
Oct 30 11:34:27.492375 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.492285    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb3962d0-9481-4f9c-9052-7b37209b6368" containerName="thanos-querier"
Oct 30 11:34:27.495271 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.495251    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.515626 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.515604    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:27.517636 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.517617    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:27.531113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.531054    4488 generic.go:356] "Generic (PLEG): container finished" podID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" containerID="bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da" exitCode=0
Oct 30 11:34:27.531113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.531098    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:34:27.531113 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.531107    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4","Type":"ContainerDied","Data":"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"}
Oct 30 11:34:27.531303 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.531157    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4","Type":"ContainerDied","Data":"0bb38d93e4e17a7bcd948e5bbb6aebb7a6b4468f9a829a56e311a414364d6f26"}
Oct 30 11:34:27.531303 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.531185    4488 scope.go:122] "RemoveContainer" containerID="bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"
Oct 30 11:34:27.539080 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.539065    4488 scope.go:122] "RemoveContainer" containerID="bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"
Oct 30 11:34:27.539384 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:27.539359    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da\": container with ID starting with bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da not found: ID does not exist" containerID="bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"
Oct 30 11:34:27.539472 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.539395    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da"} err="failed to get container status \"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da\": rpc error: code = NotFound desc = could not find container \"bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da\": container with ID starting with bd62f3ce4786d8aabe9942a9eb195ba28057359fbdceb2bb30cc486fc81a59da not found: ID does not exist"
Oct 30 11:34:27.563373 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563336    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\") pod \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") "
Oct 30 11:34:27.563480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563389    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\") pod \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") "
Oct 30 11:34:27.563480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563426    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\") pod \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") "
Oct 30 11:34:27.563480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563451    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\" (UniqueName: \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\") pod \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") "
Oct 30 11:34:27.563480 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563469    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\") pod \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\" (UID: \"bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4\") "
Oct 30 11:34:27.563708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.563643    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.564172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.564147    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.564379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.564265    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal" pod "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" (UID: "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:27.564509 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.564323    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hxz\" (UniqueName: \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.564509 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.564484    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:27.571130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.566471    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert" pod "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" (UID: "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:27.571130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.568432    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs" pod "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" (UID: "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:27.571626 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.571597    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs" pod "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" (UID: "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:27.571795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.571776    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz" pod "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" (UID: "bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4"). InnerVolumeSpecName "kube-api-access-787rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:27.665456 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665427    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.665604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665466    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.665604 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665519    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hxz\" (UniqueName: \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.665691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665606    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:27.665691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665617    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:27.665691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665628    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-787rz\" (UniqueName: \"kubernetes.io/projected/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-kube-api-access-787rz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:27.665691 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.665643    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:27.666122 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.666101    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.667862 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.667838    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.688730 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.688700    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hxz\" (UniqueName: \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\") pod \"data-science-collector-targetallocator-5869d7c5ff-7jrrt\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.815524 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.815505    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:27.871395 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.871362    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:27.878364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:27.878314    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:34:28.110281 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.110195    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:28.113946 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:28.113921    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a4d19e_ad26_4fa6_abc1_b73bca1b7c90.slice/crio-f2fedaafed46730ef98473642c7b9fbfe8984130c0dd07b09b323a217e786d6c WatchSource:0}: Error finding container f2fedaafed46730ef98473642c7b9fbfe8984130c0dd07b09b323a217e786d6c: Status 404 returned error can't find the container with id f2fedaafed46730ef98473642c7b9fbfe8984130c0dd07b09b323a217e786d6c
Oct 30 11:34:28.116184 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.116152    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:28.116247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.116209    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:28.537413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.537375    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" event={"ID":"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90","Type":"ContainerStarted","Data":"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"}
Oct 30 11:34:28.537413 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.537419    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" event={"ID":"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90","Type":"ContainerStarted","Data":"f2fedaafed46730ef98473642c7b9fbfe8984130c0dd07b09b323a217e786d6c"}
Oct 30 11:34:28.537942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.537584    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:28.538741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.538713    4488 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.189:8080/readyz\": dial tcp 10.133.0.189:8080: connect: connection refused"
Oct 30 11:34:28.580780 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:28.580726    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" podStartSLOduration=1.580708988 podStartE2EDuration="1.580708988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:28.579934271 +0000 UTC m=+2964.925526128" watchObservedRunningTime="2026-10-30 11:34:28.580708988 +0000 UTC m=+2964.926300843"
Oct 30 11:34:29.542811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.542786    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:29.613180 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.613152    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:29.613405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.613383    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerName="ta-container" containerID="cri-o://43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f" gracePeriod=30
Oct 30 11:34:29.804404 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.804318    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" path="/var/lib/kubelet/pods/bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4/volumes"
Oct 30 11:34:29.863612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.863589    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:29.983754 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.983721    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\") pod \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") "
Oct 30 11:34:29.983911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.983828    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\" (UniqueName: \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\") pod \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") "
Oct 30 11:34:29.983911 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.983860    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\") pod \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\" (UID: \"a82e09c9-b7a4-4827-80ae-fa104d70ff59\") "
Oct 30 11:34:29.984243 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.984214    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal" pod "a82e09c9-b7a4-4827-80ae-fa104d70ff59" (UID: "a82e09c9-b7a4-4827-80ae-fa104d70ff59"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:29.985683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.985658    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw" pod "a82e09c9-b7a4-4827-80ae-fa104d70ff59" (UID: "a82e09c9-b7a4-4827-80ae-fa104d70ff59"). InnerVolumeSpecName "kube-api-access-q9drw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:29.985796 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:29.985774    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert" pod "a82e09c9-b7a4-4827-80ae-fa104d70ff59" (UID: "a82e09c9-b7a4-4827-80ae-fa104d70ff59"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:30.084361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.084289    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9drw\" (UniqueName: \"kubernetes.io/projected/a82e09c9-b7a4-4827-80ae-fa104d70ff59-kube-api-access-q9drw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:30.084361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.084311    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a82e09c9-b7a4-4827-80ae-fa104d70ff59-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:30.084361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.084322    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a82e09c9-b7a4-4827-80ae-fa104d70ff59-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:30.546941 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.546909    4488 generic.go:356] "Generic (PLEG): container finished" podID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerID="43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f" exitCode=0
Oct 30 11:34:30.547435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.546955    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"
Oct 30 11:34:30.547435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.546991    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" event={"ID":"a82e09c9-b7a4-4827-80ae-fa104d70ff59","Type":"ContainerDied","Data":"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"}
Oct 30 11:34:30.547435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.547044    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2" event={"ID":"a82e09c9-b7a4-4827-80ae-fa104d70ff59","Type":"ContainerDied","Data":"d905cb78f930b9c1d35dc93325f07aa34aa7e96238c3007a607e2b4715846fb0"}
Oct 30 11:34:30.547435 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.547069    4488 scope.go:122] "RemoveContainer" containerID="43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"
Oct 30 11:34:30.555238 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.555222    4488 scope.go:122] "RemoveContainer" containerID="43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"
Oct 30 11:34:30.555610 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:30.555589    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f\": container with ID starting with 43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f not found: ID does not exist" containerID="43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"
Oct 30 11:34:30.555663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.555618    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f"} err="failed to get container status \"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f\": rpc error: code = NotFound desc = could not find container \"43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f\": container with ID starting with 43b7c3cf51876b8355462140a3fced777e926bd6b88f7fc5243858167116c91f not found: ID does not exist"
Oct 30 11:34:30.600633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.600612    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:30.613462 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:30.613440    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-545ff9b486-nb7s2"]
Oct 30 11:34:31.477764 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:31.477735    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:34:31.802494 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:31.802425    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" path="/var/lib/kubelet/pods/a82e09c9-b7a4-4827-80ae-fa104d70ff59/volumes"
Oct 30 11:34:39.365647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.365614    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:39.366023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.365967    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerName="ta-container"
Oct 30 11:34:39.366023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.365981    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerName="ta-container"
Oct 30 11:34:39.366023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.366003    4488 cpu_manager.go:414] "containerMap: removing container" podUID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" containerName="otc-container"
Oct 30 11:34:39.366023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.366008    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" containerName="otc-container"
Oct 30 11:34:39.366170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.366074    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a82e09c9-b7a4-4827-80ae-fa104d70ff59" containerName="ta-container"
Oct 30 11:34:39.366170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.366084    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf1898a8-59f1-4c23-84b6-9f9f4ce05ff4" containerName="otc-container"
Oct 30 11:34:39.368729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.368713    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.400120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.400096    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:39.455247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.455217    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.455455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.455294    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.455455 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.455328    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4hb\" (UniqueName: \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.555682 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.555652    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.555803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.555705    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.555803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.555733    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4hb\" (UniqueName: \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.556306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.556287    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.558010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.557989    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.579781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.579761    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4hb\" (UniqueName: \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\") pod \"data-science-collector-targetallocator-849654fdb4-9s8ts\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.679766 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.679739    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:39.974214 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.974133    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:39.977737 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:34:39.977709    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2332eeba_fbf9_4c98_80a5_a13bc18349bc.slice/crio-e8c464d9a2aed0ae41747499079465b379272c5d238b2a7c1a1d660f1b9a5e81 WatchSource:0}: Error finding container e8c464d9a2aed0ae41747499079465b379272c5d238b2a7c1a1d660f1b9a5e81: Status 404 returned error can't find the container with id e8c464d9a2aed0ae41747499079465b379272c5d238b2a7c1a1d660f1b9a5e81
Oct 30 11:34:39.979817 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.979786    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:39.979935 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:39.979839    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:34:40.588076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.588046    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" event={"ID":"2332eeba-fbf9-4c98-80a5-a13bc18349bc","Type":"ContainerStarted","Data":"4e84d6188cab8d07f9eb2c34fbb34f474aa3dea6ebb42b29e7eda53634d4b64e"}
Oct 30 11:34:40.588516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.588090    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" event={"ID":"2332eeba-fbf9-4c98-80a5-a13bc18349bc","Type":"ContainerStarted","Data":"e8c464d9a2aed0ae41747499079465b379272c5d238b2a7c1a1d660f1b9a5e81"}
Oct 30 11:34:40.588516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.588265    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:40.590000 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.589981    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:40.631969 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.631932    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" podStartSLOduration=1.631921511 podStartE2EDuration="1.631921511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:34:40.630622715 +0000 UTC m=+2976.976214570" watchObservedRunningTime="2026-10-30 11:34:40.631921511 +0000 UTC m=+2976.977513364"
Oct 30 11:34:40.702366 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.702320    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:40.702593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.702565    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerName="ta-container" containerID="cri-o://03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4" gracePeriod=30
Oct 30 11:34:40.940028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:40.940004    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:41.068079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.068046    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\" (UniqueName: \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\") pod \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") "
Oct 30 11:34:41.068079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.068091    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\") pod \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") "
Oct 30 11:34:41.068363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.068147    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\" (UniqueName: \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\") pod \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\" (UID: \"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90\") "
Oct 30 11:34:41.068968 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.068769    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal" pod "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" (UID: "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:41.071495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.071471    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert" pod "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" (UID: "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:41.071611 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.071494    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz" pod "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" (UID: "36a4d19e-ad26-4fa6-abc1-b73bca1b7c90"). InnerVolumeSpecName "kube-api-access-55hxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:41.169005 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.168976    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55hxz\" (UniqueName: \"kubernetes.io/projected/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-kube-api-access-55hxz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:41.169005 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.169008    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:41.169178 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.169020    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:41.593779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.593700    4488 generic.go:356] "Generic (PLEG): container finished" podID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerID="03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4" exitCode=0
Oct 30 11:34:41.593779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.593763    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"
Oct 30 11:34:41.594217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.593802    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" event={"ID":"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90","Type":"ContainerDied","Data":"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"}
Oct 30 11:34:41.594217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.593864    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt" event={"ID":"36a4d19e-ad26-4fa6-abc1-b73bca1b7c90","Type":"ContainerDied","Data":"f2fedaafed46730ef98473642c7b9fbfe8984130c0dd07b09b323a217e786d6c"}
Oct 30 11:34:41.594217 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.593884    4488 scope.go:122] "RemoveContainer" containerID="03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"
Oct 30 11:34:41.604678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.604658    4488 scope.go:122] "RemoveContainer" containerID="03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"
Oct 30 11:34:41.604943 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:41.604924    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4\": container with ID starting with 03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4 not found: ID does not exist" containerID="03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"
Oct 30 11:34:41.604989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.604950    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4"} err="failed to get container status \"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4\": rpc error: code = NotFound desc = could not find container \"03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4\": container with ID starting with 03a4e9a4f0f357399c0adbc51cd9abbfc1b777ffe99fe3b3195dcabc592d32a4 not found: ID does not exist"
Oct 30 11:34:41.646829 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.646808    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:41.659826 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.659805    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5869d7c5ff-7jrrt"]
Oct 30 11:34:41.804135 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:41.804106    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" path="/var/lib/kubelet/pods/36a4d19e-ad26-4fa6-abc1-b73bca1b7c90/volumes"
Oct 30 11:34:43.604438 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:43.604403    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:43.604915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:43.604561    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" podUID="8b52421f-7d10-4d60-803e-707ed22633cf" containerName="thanos-querier" containerID="cri-o://d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd" gracePeriod=30
Oct 30 11:34:43.878259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:43.878235    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:43.993503 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:43.993470    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\" (UniqueName: \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\") pod \"8b52421f-7d10-4d60-803e-707ed22633cf\" (UID: \"8b52421f-7d10-4d60-803e-707ed22633cf\") "
Oct 30 11:34:43.995407 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:43.995386    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s" pod "8b52421f-7d10-4d60-803e-707ed22633cf" (UID: "8b52421f-7d10-4d60-803e-707ed22633cf"). InnerVolumeSpecName "kube-api-access-8nt5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:44.093962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.093931    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nt5s\" (UniqueName: \"kubernetes.io/projected/8b52421f-7d10-4d60-803e-707ed22633cf-kube-api-access-8nt5s\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:44.418334 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.418297    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:44.418576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.418523    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" podUID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" containerName="ta-container" containerID="cri-o://4e84d6188cab8d07f9eb2c34fbb34f474aa3dea6ebb42b29e7eda53634d4b64e" gracePeriod=30
Oct 30 11:34:44.513534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.513505    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:44.513720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.513687    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" containerName="perses" containerID="cri-o://e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8" gracePeriod=30
Oct 30 11:34:44.609133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.609097    4488 generic.go:356] "Generic (PLEG): container finished" podID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" containerID="4e84d6188cab8d07f9eb2c34fbb34f474aa3dea6ebb42b29e7eda53634d4b64e" exitCode=0
Oct 30 11:34:44.609511 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.609171    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" event={"ID":"2332eeba-fbf9-4c98-80a5-a13bc18349bc","Type":"ContainerDied","Data":"4e84d6188cab8d07f9eb2c34fbb34f474aa3dea6ebb42b29e7eda53634d4b64e"}
Oct 30 11:34:44.610704 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.610680    4488 generic.go:356] "Generic (PLEG): container finished" podID="8b52421f-7d10-4d60-803e-707ed22633cf" containerID="d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd" exitCode=0
Oct 30 11:34:44.610812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.610723    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"
Oct 30 11:34:44.610812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.610748    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" event={"ID":"8b52421f-7d10-4d60-803e-707ed22633cf","Type":"ContainerDied","Data":"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"}
Oct 30 11:34:44.610812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.610787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb" event={"ID":"8b52421f-7d10-4d60-803e-707ed22633cf","Type":"ContainerDied","Data":"486e640ed3c3250a144ddb190fb0a37484626b579aae482ef6f85a8b3d05a6a9"}
Oct 30 11:34:44.610812 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.610805    4488 scope.go:122] "RemoveContainer" containerID="d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"
Oct 30 11:34:44.625634 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.625614    4488 scope.go:122] "RemoveContainer" containerID="d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"
Oct 30 11:34:44.625913 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:44.625895    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd\": container with ID starting with d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd not found: ID does not exist" containerID="d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"
Oct 30 11:34:44.625995 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.625921    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd"} err="failed to get container status \"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd\": rpc error: code = NotFound desc = could not find container \"d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd\": container with ID starting with d9dc287009ae609448b947a1e37eddfe43363cefab5af5be06fe985ebad114fd not found: ID does not exist"
Oct 30 11:34:44.660685 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.660650    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:44.663320 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.663296    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:44.667781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.667762    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-xfhcb"]
Oct 30 11:34:44.773926 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.773901    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:44.800632 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.800605    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\" (UniqueName: \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\") pod \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") "
Oct 30 11:34:44.800753 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.800694    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\") pod \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") "
Oct 30 11:34:44.800753 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.800738    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\") pod \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\" (UID: \"2332eeba-fbf9-4c98-80a5-a13bc18349bc\") "
Oct 30 11:34:44.801041 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.801019    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal" pod "2332eeba-fbf9-4c98-80a5-a13bc18349bc" (UID: "2332eeba-fbf9-4c98-80a5-a13bc18349bc"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:44.802564 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.802541    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb" pod "2332eeba-fbf9-4c98-80a5-a13bc18349bc" (UID: "2332eeba-fbf9-4c98-80a5-a13bc18349bc"). InnerVolumeSpecName "kube-api-access-kh4hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:44.802646 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.802586    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert" pod "2332eeba-fbf9-4c98-80a5-a13bc18349bc" (UID: "2332eeba-fbf9-4c98-80a5-a13bc18349bc"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:34:44.901319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901291    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\") pod \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") "
Oct 30 11:34:44.901461 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901392    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\" (UniqueName: \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\") pod \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") "
Oct 30 11:34:44.901527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901508    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") "
Oct 30 11:34:44.901593 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901580    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\" (UniqueName: \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\") pod \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\" (UID: \"0ac4cb46-910d-4bd0-880b-0d4823af1c46\") "
Oct 30 11:34:44.901972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901800    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh4hb\" (UniqueName: \"kubernetes.io/projected/2332eeba-fbf9-4c98-80a5-a13bc18349bc-kube-api-access-kh4hb\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:44.901972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901821    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2332eeba-fbf9-4c98-80a5-a13bc18349bc-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:44.901972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.901836    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2332eeba-fbf9-4c98-80a5-a13bc18349bc-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:44.902252 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.902007    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config" pod "0ac4cb46-910d-4bd0-880b-0d4823af1c46" (UID: "0ac4cb46-910d-4bd0-880b-0d4823af1c46"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:34:44.903492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.903469    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk" pod "0ac4cb46-910d-4bd0-880b-0d4823af1c46" (UID: "0ac4cb46-910d-4bd0-880b-0d4823af1c46"). InnerVolumeSpecName "kube-api-access-4zxzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:34:44.904118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:44.904100    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "0ac4cb46-910d-4bd0-880b-0d4823af1c46" (UID: "0ac4cb46-910d-4bd0-880b-0d4823af1c46"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:34:45.002312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.002249    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ac4cb46-910d-4bd0-880b-0d4823af1c46-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:45.002312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.002273    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zxzk\" (UniqueName: \"kubernetes.io/projected/0ac4cb46-910d-4bd0-880b-0d4823af1c46-kube-api-access-4zxzk\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:45.002312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.002300    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:34:45.014220 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.014204    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:34:45.053711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.053687    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins" pod "0ac4cb46-910d-4bd0-880b-0d4823af1c46" (UID: "0ac4cb46-910d-4bd0-880b-0d4823af1c46"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:34:45.103242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.103218    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:34:45.103242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.103240    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/0ac4cb46-910d-4bd0-880b-0d4823af1c46-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:34:45.617066 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.617039    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"
Oct 30 11:34:45.617566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.617065    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts" event={"ID":"2332eeba-fbf9-4c98-80a5-a13bc18349bc","Type":"ContainerDied","Data":"e8c464d9a2aed0ae41747499079465b379272c5d238b2a7c1a1d660f1b9a5e81"}
Oct 30 11:34:45.617566 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.617131    4488 scope.go:122] "RemoveContainer" containerID="4e84d6188cab8d07f9eb2c34fbb34f474aa3dea6ebb42b29e7eda53634d4b64e"
Oct 30 11:34:45.618833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.618589    4488 generic.go:356] "Generic (PLEG): container finished" podID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" containerID="e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8" exitCode=0
Oct 30 11:34:45.618833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.618677    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:34:45.618833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.618680    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"0ac4cb46-910d-4bd0-880b-0d4823af1c46","Type":"ContainerDied","Data":"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"}
Oct 30 11:34:45.618833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.618723    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"0ac4cb46-910d-4bd0-880b-0d4823af1c46","Type":"ContainerDied","Data":"fbb971dfd8e1b50adac3a2e3ebb503fa845c444339d4323fecdaeb666a40a445"}
Oct 30 11:34:45.626914 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.626898    4488 scope.go:122] "RemoveContainer" containerID="e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"
Oct 30 11:34:45.634155 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.634139    4488 scope.go:122] "RemoveContainer" containerID="e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"
Oct 30 11:34:45.634418 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:34:45.634401    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8\": container with ID starting with e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8 not found: ID does not exist" containerID="e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"
Oct 30 11:34:45.634491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.634425    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8"} err="failed to get container status \"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8\": rpc error: code = NotFound desc = could not find container \"e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8\": container with ID starting with e95f578fa65933e954ce356fda39e25cd420b17e321209e29279243499d80bf8 not found: ID does not exist"
Oct 30 11:34:45.670139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.670115    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:45.682874 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.682852    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:34:45.717869 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.717833    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:45.721720 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.721697    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-849654fdb4-9s8ts"]
Oct 30 11:34:45.801782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.801760    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" path="/var/lib/kubelet/pods/0ac4cb46-910d-4bd0-880b-0d4823af1c46/volumes"
Oct 30 11:34:45.802118 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.802104    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" path="/var/lib/kubelet/pods/2332eeba-fbf9-4c98-80a5-a13bc18349bc/volumes"
Oct 30 11:34:45.802407 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:34:45.802386    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b52421f-7d10-4d60-803e-707ed22633cf" path="/var/lib/kubelet/pods/8b52421f-7d10-4d60-803e-707ed22633cf/volumes"
Oct 30 11:35:00.935576 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935543    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935877    4488 cpu_manager.go:414] "containerMap: removing container" podUID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935888    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935916    4488 cpu_manager.go:414] "containerMap: removing container" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935924    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935935    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8b52421f-7d10-4d60-803e-707ed22633cf" containerName="thanos-querier"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935940    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b52421f-7d10-4d60-803e-707ed22633cf" containerName="thanos-querier"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935952    4488 cpu_manager.go:414] "containerMap: removing container" podUID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" containerName="perses"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.935957    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" containerName="perses"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.936009    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="2332eeba-fbf9-4c98-80a5-a13bc18349bc" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.936022    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="36a4d19e-ad26-4fa6-abc1-b73bca1b7c90" containerName="ta-container"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.936030    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b52421f-7d10-4d60-803e-707ed22633cf" containerName="thanos-querier"
Oct 30 11:35:00.936053 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.936038    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ac4cb46-910d-4bd0-880b-0d4823af1c46" containerName="perses"
Oct 30 11:35:00.939085 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.939069    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:00.955712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.955690    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:35:00.957031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.957002    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:00.968765 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.968745    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:35:00.969023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:00.969007    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:35:01.016863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.016833    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm8ks\" (UniqueName: \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs\" (UID: \"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:01.118170 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.118141    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm8ks\" (UniqueName: \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs\" (UID: \"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:01.142760 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.142733    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm8ks\" (UniqueName: \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs\" (UID: \"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:01.253301 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.253235    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:01.477572 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:01.477543    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:35:01.545556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.545484    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:01.548962 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:01.548933    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ff4ab2_c019_46d0_ba94_43e2a9f513ed.slice/crio-dcdb312b768cbc0eef0e89019ec3c2e19bcba49ecd070603f92a8a0a98fdbf86 WatchSource:0}: Error finding container dcdb312b768cbc0eef0e89019ec3c2e19bcba49ecd070603f92a8a0a98fdbf86: Status 404 returned error can't find the container with id dcdb312b768cbc0eef0e89019ec3c2e19bcba49ecd070603f92a8a0a98fdbf86
Oct 30 11:35:01.683772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.683741    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" event={"ID":"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed","Type":"ContainerStarted","Data":"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"}
Oct 30 11:35:01.683920 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.683787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" event={"ID":"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed","Type":"ContainerStarted","Data":"dcdb312b768cbc0eef0e89019ec3c2e19bcba49ecd070603f92a8a0a98fdbf86"}
Oct 30 11:35:01.724666 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:01.724620    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" podStartSLOduration=1.724601249 podStartE2EDuration="1.724601249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:01.723702002 +0000 UTC m=+2998.069293857" watchObservedRunningTime="2026-10-30 11:35:01.724601249 +0000 UTC m=+2998.070193105"
Oct 30 11:35:02.008843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.008811    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:02.012046 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.012030    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.041803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.041775    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:35:02.042735 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.042713    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:02.045954 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.045933    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:02.046060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.046040    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.064891 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.064864    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:02.073556 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.073533    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:35:02.073884 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.073868    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:35:02.074029 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.074011    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:35:02.074236 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.074223    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:35:02.074306 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.074279    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-7p6tb\""
Oct 30 11:35:02.110742 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.110715    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:02.113891 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.113871    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.127144 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127122    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.127230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127154    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.127230 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127177    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.127364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127317    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.127412 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127379    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7x2m\" (UniqueName: \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.127448 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127429    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.127496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127481    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rpx\" (UniqueName: \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.127535 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.127508    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.134226 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.134197    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:02.173149 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.173127    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:35:02.173823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.173802    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-8fsmk\""
Oct 30 11:35:02.173908 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.173839    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:35:02.228539 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228516    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.228647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228548    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.228647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228565    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7x2m\" (UniqueName: \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.228647 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228591    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.228836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228659    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.228836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228769    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rpx\" (UniqueName: \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.228836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228795    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.228836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228834    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.229048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228852    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.229048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228874    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.229048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.228915    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c22l\" (UniqueName: \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.229266 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.229246    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.229579 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.229562    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.229669 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.229563    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.231247 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.231224    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.231459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.231444    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.231594 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.231576    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.254768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.254749    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rpx\" (UniqueName: \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\") pod \"data-science-collector-collector-1\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.254768 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.254761    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7x2m\" (UniqueName: \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:02.324378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.324312    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:02.329575 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.329549    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.329679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.329611    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c22l\" (UniqueName: \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.329679 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.329640    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.330223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.330201    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.331772 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.331747    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.353572 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.353546    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c22l\" (UniqueName: \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\") pod \"data-science-collector-targetallocator-5ff9456f94-78x8w\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.425302 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.425272    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:02.651588 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.651503    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:02.655195 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:02.655166    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dfe1ca_e087_4f61_b313_d1484f1f2556.slice/crio-206cc4d24462230f31c16c0573885e9fd01b7c6c307b7dc25f3f507df4478884 WatchSource:0}: Error finding container 206cc4d24462230f31c16c0573885e9fd01b7c6c307b7dc25f3f507df4478884: Status 404 returned error can't find the container with id 206cc4d24462230f31c16c0573885e9fd01b7c6c307b7dc25f3f507df4478884
Oct 30 11:35:02.657257 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.657223    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:02.657357 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.657282    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:02.688664 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.688638    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"e9dfe1ca-e087-4f61-b313-d1484f1f2556","Type":"ContainerStarted","Data":"206cc4d24462230f31c16c0573885e9fd01b7c6c307b7dc25f3f507df4478884"}
Oct 30 11:35:02.722379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.722328    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:02.725890 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:02.725869    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fadc1ae_5f8c_4bb3_9ec0_bac51454b6ac.slice/crio-e20724b7672edf3ce5315db3e254650d19143c11f8925e4ef24d22bd93f9a9b4 WatchSource:0}: Error finding container e20724b7672edf3ce5315db3e254650d19143c11f8925e4ef24d22bd93f9a9b4: Status 404 returned error can't find the container with id e20724b7672edf3ce5315db3e254650d19143c11f8925e4ef24d22bd93f9a9b4
Oct 30 11:35:02.728210 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.728179    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:02.728272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:02.728236    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:03.694835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.694787    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" event={"ID":"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac","Type":"ContainerStarted","Data":"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"}
Oct 30 11:35:03.695274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.694843    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" event={"ID":"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac","Type":"ContainerStarted","Data":"e20724b7672edf3ce5315db3e254650d19143c11f8925e4ef24d22bd93f9a9b4"}
Oct 30 11:35:03.695274 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.694867    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:03.696626 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.696601    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"e9dfe1ca-e087-4f61-b313-d1484f1f2556","Type":"ContainerStarted","Data":"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"}
Oct 30 11:35:03.696777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.696761    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:03.737998 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.737952    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" podStartSLOduration=1.737940552 podStartE2EDuration="1.737940552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:03.736677875 +0000 UTC m=+3000.082269728" watchObservedRunningTime="2026-10-30 11:35:03.737940552 +0000 UTC m=+3000.083532405"
Oct 30 11:35:03.780743 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:03.780706    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.780694737 podStartE2EDuration="2.780694737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:03.77991863 +0000 UTC m=+3000.125510484" watchObservedRunningTime="2026-10-30 11:35:03.780694737 +0000 UTC m=+3000.126286588"
Oct 30 11:35:04.480992 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.480953    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:04.484505 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.484487    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:04.505102 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.505079    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:04.547286 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.547259    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttwj\" (UniqueName: \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp\" (UID: \"55c837f6-fba0-455a-827d-a4de8446028e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:04.648162 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.648133    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttwj\" (UniqueName: \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp\" (UID: \"55c837f6-fba0-455a-827d-a4de8446028e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:04.671949 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.671929    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttwj\" (UniqueName: \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp\" (UID: \"55c837f6-fba0-455a-827d-a4de8446028e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:04.800008 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:04.799957    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:05.093392 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.093296    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:05.096765 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:05.096734    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55c837f6_fba0_455a_827d_a4de8446028e.slice/crio-b3bab74f8965800360f116b8fda468dbf4cd3a8ad59dd5dea1a423992c4083cc WatchSource:0}: Error finding container b3bab74f8965800360f116b8fda468dbf4cd3a8ad59dd5dea1a423992c4083cc: Status 404 returned error can't find the container with id b3bab74f8965800360f116b8fda468dbf4cd3a8ad59dd5dea1a423992c4083cc
Oct 30 11:35:05.705115 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.705080    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" event={"ID":"55c837f6-fba0-455a-827d-a4de8446028e","Type":"ContainerStarted","Data":"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"}
Oct 30 11:35:05.705388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.705124    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" event={"ID":"55c837f6-fba0-455a-827d-a4de8446028e","Type":"ContainerStarted","Data":"b3bab74f8965800360f116b8fda468dbf4cd3a8ad59dd5dea1a423992c4083cc"}
Oct 30 11:35:05.746463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.746411    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" podStartSLOduration=1.7463911269999999 podStartE2EDuration="1.746391127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:05.745734901 +0000 UTC m=+3002.091326756" watchObservedRunningTime="2026-10-30 11:35:05.746391127 +0000 UTC m=+3002.091982980"
Oct 30 11:35:05.760159 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.760121    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:05.770612 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.770586    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:05.770745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.770727    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" podUID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" containerName="thanos-querier" containerID="cri-o://04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af" gracePeriod=30
Oct 30 11:35:05.791985 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.791961    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:05.861609 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.861587    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:05.861909 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.861715    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:05.876506 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.876479    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:05.978277 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:05.978245    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:06.008492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.008471    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:06.012318 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.012293    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:06.063177 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.063152    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\" (UniqueName: \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\") pod \"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed\" (UID: \"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed\") "
Oct 30 11:35:06.065101 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.065073    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks" pod "f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" (UID: "f4ff4ab2-c019-46d0-ba94-43e2a9f513ed"). InnerVolumeSpecName "kube-api-access-xm8ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:06.164158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.164137    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm8ks\" (UniqueName: \"kubernetes.io/projected/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed-kube-api-access-xm8ks\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:06.256551 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.256487    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:06.550818 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.550641    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:06.553209 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:06.553184    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6487687_fccb_47cd_8521_f2d0a5cf5c82.slice/crio-194387d717b9002e0f05cef8021098bb4842007ae797ee9f3565cfafea382657 WatchSource:0}: Error finding container 194387d717b9002e0f05cef8021098bb4842007ae797ee9f3565cfafea382657: Status 404 returned error can't find the container with id 194387d717b9002e0f05cef8021098bb4842007ae797ee9f3565cfafea382657
Oct 30 11:35:06.711033 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.710998    4488 generic.go:356] "Generic (PLEG): container finished" podID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" containerID="04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af" exitCode=0
Oct 30 11:35:06.711201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.711050    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"
Oct 30 11:35:06.711201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.711093    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" event={"ID":"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed","Type":"ContainerDied","Data":"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"}
Oct 30 11:35:06.711201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.711148    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs" event={"ID":"f4ff4ab2-c019-46d0-ba94-43e2a9f513ed","Type":"ContainerDied","Data":"dcdb312b768cbc0eef0e89019ec3c2e19bcba49ecd070603f92a8a0a98fdbf86"}
Oct 30 11:35:06.711201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.711173    4488 scope.go:122] "RemoveContainer" containerID="04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"
Oct 30 11:35:06.712967 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.712942    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a6487687-fccb-47cd-8521-f2d0a5cf5c82","Type":"ContainerStarted","Data":"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"}
Oct 30 11:35:06.713096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.712985    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:06.713096 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.713001    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a6487687-fccb-47cd-8521-f2d0a5cf5c82","Type":"ContainerStarted","Data":"194387d717b9002e0f05cef8021098bb4842007ae797ee9f3565cfafea382657"}
Oct 30 11:35:06.720069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.720048    4488 scope.go:122] "RemoveContainer" containerID="04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"
Oct 30 11:35:06.720350 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:06.720320    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af\": container with ID starting with 04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af not found: ID does not exist" containerID="04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"
Oct 30 11:35:06.720408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.720362    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af"} err="failed to get container status \"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af\": rpc error: code = NotFound desc = could not find container \"04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af\": container with ID starting with 04107d0290084d2da7db547d5fc545338aedeb27c3cee7ed767993f2610003af not found: ID does not exist"
Oct 30 11:35:06.763304 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.763280    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:06.766806 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.766787    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-ckxgs"]
Oct 30 11:35:06.807626 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:06.807540    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.807522282 podStartE2EDuration="4.807522282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:06.807387835 +0000 UTC m=+3003.152979689" watchObservedRunningTime="2026-10-30 11:35:06.807522282 +0000 UTC m=+3003.153114138"
Oct 30 11:35:07.803630 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:07.803594    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" path="/var/lib/kubelet/pods/f4ff4ab2-c019-46d0-ba94-43e2a9f513ed/volumes"
Oct 30 11:35:17.720259 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:17.720179    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:21.378101 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.378065    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:21.378620 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.378290    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" containerName="otc-container" containerID="cri-o://1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881" gracePeriod=30
Oct 30 11:35:21.574527 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.574488    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:21.575002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.574983    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" containerName="thanos-querier"
Oct 30 11:35:21.575060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.575008    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" containerName="thanos-querier"
Oct 30 11:35:21.575130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.575117    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4ff4ab2-c019-46d0-ba94-43e2a9f513ed" containerName="thanos-querier"
Oct 30 11:35:21.579843 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.579823    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.596925 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.596903    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:21.622779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.622755    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:21.675432 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.675401    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.675548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.675448    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.675548 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.675510    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl6kv\" (UniqueName: \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.773198 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.773169    4488 generic.go:356] "Generic (PLEG): container finished" podID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" containerID="1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881" exitCode=0
Oct 30 11:35:21.773312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.773216    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:21.773312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.773248    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"e9dfe1ca-e087-4f61-b313-d1484f1f2556","Type":"ContainerDied","Data":"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"}
Oct 30 11:35:21.773312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.773299    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"e9dfe1ca-e087-4f61-b313-d1484f1f2556","Type":"ContainerDied","Data":"206cc4d24462230f31c16c0573885e9fd01b7c6c307b7dc25f3f507df4478884"}
Oct 30 11:35:21.773446 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.773320    4488 scope.go:122] "RemoveContainer" containerID="1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"
Oct 30 11:35:21.776532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776512    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\") pod \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") "
Oct 30 11:35:21.776657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776571    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\" (UniqueName: \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\") pod \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") "
Oct 30 11:35:21.776657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776601    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\" (UniqueName: \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\") pod \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") "
Oct 30 11:35:21.776657 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776637    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\") pod \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") "
Oct 30 11:35:21.776825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776691    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\") pod \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\" (UID: \"e9dfe1ca-e087-4f61-b313-d1484f1f2556\") "
Oct 30 11:35:21.776940 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776915    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.777076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.776962    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.777076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.777006    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl6kv\" (UniqueName: \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.777076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.777043    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal" pod "e9dfe1ca-e087-4f61-b313-d1484f1f2556" (UID: "e9dfe1ca-e087-4f61-b313-d1484f1f2556"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:21.778071 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.778022    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.779060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.779039    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs" pod "e9dfe1ca-e087-4f61-b313-d1484f1f2556" (UID: "e9dfe1ca-e087-4f61-b313-d1484f1f2556"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:21.779258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.779240    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx" pod "e9dfe1ca-e087-4f61-b313-d1484f1f2556" (UID: "e9dfe1ca-e087-4f61-b313-d1484f1f2556"). InnerVolumeSpecName "kube-api-access-28rpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:21.779491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.779471    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert" pod "e9dfe1ca-e087-4f61-b313-d1484f1f2556" (UID: "e9dfe1ca-e087-4f61-b313-d1484f1f2556"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:21.779563 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.779518    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs" pod "e9dfe1ca-e087-4f61-b313-d1484f1f2556" (UID: "e9dfe1ca-e087-4f61-b313-d1484f1f2556"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:21.779823 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.779805    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.783001 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.782984    4488 scope.go:122] "RemoveContainer" containerID="1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"
Oct 30 11:35:21.783278 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:21.783258    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881\": container with ID starting with 1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881 not found: ID does not exist" containerID="1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"
Oct 30 11:35:21.783326 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.783285    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881"} err="failed to get container status \"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881\": rpc error: code = NotFound desc = could not find container \"1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881\": container with ID starting with 1df8e1182ddb0167d979ffcf764c4b6a47c9b01238914e39536915ce303e8881 not found: ID does not exist"
Oct 30 11:35:21.801742 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.801724    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl6kv\" (UniqueName: \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\") pod \"data-science-collector-targetallocator-7f5c5cb6bc-9qzzr\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:21.878167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.878149    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rpx\" (UniqueName: \"kubernetes.io/projected/e9dfe1ca-e087-4f61-b313-d1484f1f2556-kube-api-access-28rpx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:21.878167 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.878168    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e9dfe1ca-e087-4f61-b313-d1484f1f2556-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:21.878299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.878179    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:21.878299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.878188    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:21.878299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.878197    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9dfe1ca-e087-4f61-b313-d1484f1f2556-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:21.891108 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:21.891086    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:22.112489 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.112458    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:22.125443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.125415    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:22.183897 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.183874    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:22.187170 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:22.187111    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63fe649c_da43_4a92_ae8f_b7d51404554c.slice/crio-b0d395e421974bc0e0c571499af513a030ba272c30d3c7f0363771439159908d WatchSource:0}: Error finding container b0d395e421974bc0e0c571499af513a030ba272c30d3c7f0363771439159908d: Status 404 returned error can't find the container with id b0d395e421974bc0e0c571499af513a030ba272c30d3c7f0363771439159908d
Oct 30 11:35:22.189289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.189257    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:22.189406 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.189315    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:22.779722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.779686    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" event={"ID":"63fe649c-da43-4a92-ae8f-b7d51404554c","Type":"ContainerStarted","Data":"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"}
Oct 30 11:35:22.779722 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.779722    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" event={"ID":"63fe649c-da43-4a92-ae8f-b7d51404554c","Type":"ContainerStarted","Data":"b0d395e421974bc0e0c571499af513a030ba272c30d3c7f0363771439159908d"}
Oct 30 11:35:22.780201 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.779831    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:22.781355 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.781321    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:22.822332 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.822283    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" podStartSLOduration=1.822272129 podStartE2EDuration="1.822272129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:22.821333549 +0000 UTC m=+3019.166925403" watchObservedRunningTime="2026-10-30 11:35:22.822272129 +0000 UTC m=+3019.167863982"
Oct 30 11:35:22.892712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.892687    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:22.893011 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:22.892881    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" podUID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" containerName="ta-container" containerID="cri-o://c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70" gracePeriod=30
Oct 30 11:35:23.124752 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.124728    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:23.287758 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.287726    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\") pod \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") "
Oct 30 11:35:23.287893 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.287775    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\" (UniqueName: \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\") pod \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") "
Oct 30 11:35:23.287893 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.287805    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\" (UniqueName: \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\") pod \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\" (UID: \"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac\") "
Oct 30 11:35:23.288172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.288150    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal" pod "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" (UID: "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:23.289782 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.289757    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert" pod "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" (UID: "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:23.289906 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.289885    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l" pod "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" (UID: "7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac"). InnerVolumeSpecName "kube-api-access-4c22l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:23.388905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.388837    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:23.388905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.388864    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:23.388905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.388875    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c22l\" (UniqueName: \"kubernetes.io/projected/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac-kube-api-access-4c22l\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:23.784383 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.784335    4488 generic.go:356] "Generic (PLEG): container finished" podID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" containerID="c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70" exitCode=0
Oct 30 11:35:23.784784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.784395    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"
Oct 30 11:35:23.784784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.784438    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" event={"ID":"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac","Type":"ContainerDied","Data":"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"}
Oct 30 11:35:23.784784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.784485    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w" event={"ID":"7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac","Type":"ContainerDied","Data":"e20724b7672edf3ce5315db3e254650d19143c11f8925e4ef24d22bd93f9a9b4"}
Oct 30 11:35:23.784784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.784506    4488 scope.go:122] "RemoveContainer" containerID="c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"
Oct 30 11:35:23.794583 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.794259    4488 scope.go:122] "RemoveContainer" containerID="c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"
Oct 30 11:35:23.795098 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:23.795075    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70\": container with ID starting with c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70 not found: ID does not exist" containerID="c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"
Oct 30 11:35:23.795194 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.795103    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70"} err="failed to get container status \"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70\": rpc error: code = NotFound desc = could not find container \"c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70\": container with ID starting with c8271e1d40c35b33a865cc46a030c839b55719b7d1d41319b501f89eff5def70 not found: ID does not exist"
Oct 30 11:35:23.802271 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.802249    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" path="/var/lib/kubelet/pods/e9dfe1ca-e087-4f61-b313-d1484f1f2556/volumes"
Oct 30 11:35:23.839781 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.839759    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:23.852740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:23.852717    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5ff9456f94-78x8w"]
Oct 30 11:35:25.806049 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:25.806012    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" path="/var/lib/kubelet/pods/7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac/volumes"
Oct 30 11:35:31.477678 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:31.477644    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:35:32.350101 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350066    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350373    4488 cpu_manager.go:414] "containerMap: removing container" podUID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" containerName="ta-container"
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350385    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" containerName="ta-container"
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350405    4488 cpu_manager.go:414] "containerMap: removing container" podUID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" containerName="otc-container"
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350412    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" containerName="otc-container"
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350468    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fadc1ae-5f8c-4bb3-9ec0-bac51454b6ac" containerName="ta-container"
Oct 30 11:35:32.352278 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.350478    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9dfe1ca-e087-4f61-b313-d1484f1f2556" containerName="otc-container"
Oct 30 11:35:32.353156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.353136    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.386995 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.386973    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:32.454860 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.454834    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtlm\" (UniqueName: \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.454963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.454880    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.454963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.454944    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.555749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.555724    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.556089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.555783    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.556089 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.555826    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtlm\" (UniqueName: \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.556328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.556305    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.558250 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.558230    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.580031 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.580010    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtlm\" (UniqueName: \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\") pod \"data-science-collector-targetallocator-fd654f4cc-wswnf\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.664385 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.664317    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:32.957822 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.957794    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:32.961174 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:32.961147    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d85e2c8_87fe_45ea_868f_eeea05c8c7b2.slice/crio-13ed10781ab2548038edba677f125a660dbc15b3d2beaa6e6e45f7d4b23afac1 WatchSource:0}: Error finding container 13ed10781ab2548038edba677f125a660dbc15b3d2beaa6e6e45f7d4b23afac1: Status 404 returned error can't find the container with id 13ed10781ab2548038edba677f125a660dbc15b3d2beaa6e6e45f7d4b23afac1
Oct 30 11:35:32.963309 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.963275    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:32.963436 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:32.963334    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:33.824142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.824108    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" event={"ID":"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2","Type":"ContainerStarted","Data":"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"}
Oct 30 11:35:33.824142 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.824145    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" event={"ID":"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2","Type":"ContainerStarted","Data":"13ed10781ab2548038edba677f125a660dbc15b3d2beaa6e6e45f7d4b23afac1"}
Oct 30 11:35:33.824643 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.824313    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:33.826128 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.826098    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:33.867379 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.867308    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" podStartSLOduration=1.8672958400000002 podStartE2EDuration="1.86729584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:33.866227561 +0000 UTC m=+3030.211819427" watchObservedRunningTime="2026-10-30 11:35:33.86729584 +0000 UTC m=+3030.212887694"
Oct 30 11:35:33.937504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.937481    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:33.937660 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:33.937641    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" podUID="63fe649c-da43-4a92-ae8f-b7d51404554c" containerName="ta-container" containerID="cri-o://ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37" gracePeriod=30
Oct 30 11:35:34.171644 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.171618    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:34.268975 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.268950    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\") pod \"63fe649c-da43-4a92-ae8f-b7d51404554c\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") "
Oct 30 11:35:34.269112 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.268985    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\" (UniqueName: \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\") pod \"63fe649c-da43-4a92-ae8f-b7d51404554c\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") "
Oct 30 11:35:34.269157 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.269125    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\") pod \"63fe649c-da43-4a92-ae8f-b7d51404554c\" (UID: \"63fe649c-da43-4a92-ae8f-b7d51404554c\") "
Oct 30 11:35:34.269388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.269360    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal" pod "63fe649c-da43-4a92-ae8f-b7d51404554c" (UID: "63fe649c-da43-4a92-ae8f-b7d51404554c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:34.271043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.271017    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert" pod "63fe649c-da43-4a92-ae8f-b7d51404554c" (UID: "63fe649c-da43-4a92-ae8f-b7d51404554c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:34.271043 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.271018    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv" pod "63fe649c-da43-4a92-ae8f-b7d51404554c" (UID: "63fe649c-da43-4a92-ae8f-b7d51404554c"). InnerVolumeSpecName "kube-api-access-bl6kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:34.370363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.370293    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/63fe649c-da43-4a92-ae8f-b7d51404554c-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:34.370363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.370312    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl6kv\" (UniqueName: \"kubernetes.io/projected/63fe649c-da43-4a92-ae8f-b7d51404554c-kube-api-access-bl6kv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:34.370363 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.370323    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/63fe649c-da43-4a92-ae8f-b7d51404554c-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:34.421923 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.421896    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:34.422206 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.422193    4488 cpu_manager.go:414] "containerMap: removing container" podUID="63fe649c-da43-4a92-ae8f-b7d51404554c" containerName="ta-container"
Oct 30 11:35:34.422300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.422208    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63fe649c-da43-4a92-ae8f-b7d51404554c" containerName="ta-container"
Oct 30 11:35:34.422360 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.422303    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="63fe649c-da43-4a92-ae8f-b7d51404554c" containerName="ta-container"
Oct 30 11:35:34.425279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.425263    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.444328 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.444281    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:35:34.445360 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.445317    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:34.456467 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.456448    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:35:34.456582 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.456525    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-7p6tb\""
Oct 30 11:35:34.456665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.456594    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:35:34.456665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.456635    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:35:34.571868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.571838    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.571978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.571890    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.571978 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.571916    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.572067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.571986    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.572067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.572021    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhlc\" (UniqueName: \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.673227 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.673204    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhlc\" (UniqueName: \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.673394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.673270    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.673394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.673324    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.673394 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.673371    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.673587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.673408    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.674019 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.674000    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.675639 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.675620    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.675718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.675655    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.675790 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.675724    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.697133 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.697104    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhlc\" (UniqueName: \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\") pod \"data-science-collector-collector-1\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.737048 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.737027    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:34.830728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.830698    4488 generic.go:356] "Generic (PLEG): container finished" podID="63fe649c-da43-4a92-ae8f-b7d51404554c" containerID="ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37" exitCode=0
Oct 30 11:35:34.831082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.830760    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"
Oct 30 11:35:34.831082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.830774    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" event={"ID":"63fe649c-da43-4a92-ae8f-b7d51404554c","Type":"ContainerDied","Data":"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"}
Oct 30 11:35:34.831082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.830815    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr" event={"ID":"63fe649c-da43-4a92-ae8f-b7d51404554c","Type":"ContainerDied","Data":"b0d395e421974bc0e0c571499af513a030ba272c30d3c7f0363771439159908d"}
Oct 30 11:35:34.831082 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.830832    4488 scope.go:122] "RemoveContainer" containerID="ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"
Oct 30 11:35:34.838879 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.838863    4488 scope.go:122] "RemoveContainer" containerID="ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"
Oct 30 11:35:34.839145 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:34.839126    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37\": container with ID starting with ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37 not found: ID does not exist" containerID="ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"
Oct 30 11:35:34.839204 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.839155    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37"} err="failed to get container status \"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37\": rpc error: code = NotFound desc = could not find container \"ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37\": container with ID starting with ab7cf0cc8814b5cee5c6f58f923d4e5bd2770d83779e920c1d5c525694717c37 not found: ID does not exist"
Oct 30 11:35:34.884117 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.884093    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:34.888291 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:34.888272    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f5c5cb6bc-9qzzr"]
Oct 30 11:35:35.039122 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.039057    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:35.041837 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:35.041807    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4e008f_37ab_4b68_ad99_50981d43e81d.slice/crio-e3ff9bfa18ccb092995c89a8fad7c487b5bc4be2fc4d36c243e4797ebfbcd22d WatchSource:0}: Error finding container e3ff9bfa18ccb092995c89a8fad7c487b5bc4be2fc4d36c243e4797ebfbcd22d: Status 404 returned error can't find the container with id e3ff9bfa18ccb092995c89a8fad7c487b5bc4be2fc4d36c243e4797ebfbcd22d
Oct 30 11:35:35.043811 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.043773    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:35.043905 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.043881    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:35.803235 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.803199    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63fe649c-da43-4a92-ae8f-b7d51404554c" path="/var/lib/kubelet/pods/63fe649c-da43-4a92-ae8f-b7d51404554c/volumes"
Oct 30 11:35:35.837492 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.837461    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"8c4e008f-37ab-4b68-ad99-50981d43e81d","Type":"ContainerStarted","Data":"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"}
Oct 30 11:35:35.837856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.837512    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"8c4e008f-37ab-4b68-ad99-50981d43e81d","Type":"ContainerStarted","Data":"e3ff9bfa18ccb092995c89a8fad7c487b5bc4be2fc4d36c243e4797ebfbcd22d"}
Oct 30 11:35:35.881668 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:35.881625    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.881612686 podStartE2EDuration="1.881612686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:35.88112601 +0000 UTC m=+3032.226717864" watchObservedRunningTime="2026-10-30 11:35:35.881612686 +0000 UTC m=+3032.227204534"
Oct 30 11:35:36.387697 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.387665    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:36.387889 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.387852    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" podUID="55c837f6-fba0-455a-827d-a4de8446028e" containerName="thanos-querier" containerID="cri-o://08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb" gracePeriod=30
Oct 30 11:35:36.430326 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.430298    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"]
Oct 30 11:35:36.433693 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.433665    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.446988 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.446965    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"]
Oct 30 11:35:36.468065 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:36.468037    4488 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-542b2], unattached volumes=[], failed to process volumes=[kube-api-access-542b2]: context canceled" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs" podUID="b6efd006-27c2-44dd-8b6c-532aaa619ddf"
Oct 30 11:35:36.510712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.509871    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"]
Oct 30 11:35:36.590300 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.590256    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-542b2\" (UniqueName: \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs\" (UID: \"b6efd006-27c2-44dd-8b6c-532aaa619ddf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.651332 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.651279    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:36.691143 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.691119    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542b2\" (UniqueName: \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs\" (UID: \"b6efd006-27c2-44dd-8b6c-532aaa619ddf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.716208 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.716186    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-542b2\" (UniqueName: \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs\" (UID: \"b6efd006-27c2-44dd-8b6c-532aaa619ddf\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.792299 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.792276    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\" (UniqueName: \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\") pod \"55c837f6-fba0-455a-827d-a4de8446028e\" (UID: \"55c837f6-fba0-455a-827d-a4de8446028e\") "
Oct 30 11:35:36.794079 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.794054    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj" pod "55c837f6-fba0-455a-827d-a4de8446028e" (UID: "55c837f6-fba0-455a-827d-a4de8446028e"). InnerVolumeSpecName "kube-api-access-xttwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:36.843154 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843126    4488 generic.go:356] "Generic (PLEG): container finished" podID="55c837f6-fba0-455a-827d-a4de8446028e" containerID="08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb" exitCode=0
Oct 30 11:35:36.843531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843169    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"
Oct 30 11:35:36.843531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843169    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" event={"ID":"55c837f6-fba0-455a-827d-a4de8446028e","Type":"ContainerDied","Data":"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"}
Oct 30 11:35:36.843531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843219    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp" event={"ID":"55c837f6-fba0-455a-827d-a4de8446028e","Type":"ContainerDied","Data":"b3bab74f8965800360f116b8fda468dbf4cd3a8ad59dd5dea1a423992c4083cc"}
Oct 30 11:35:36.843531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843239    4488 scope.go:122] "RemoveContainer" containerID="08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"
Oct 30 11:35:36.843531 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.843333    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.850495 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.850472    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:36.851578 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.851560    4488 scope.go:122] "RemoveContainer" containerID="08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"
Oct 30 11:35:36.851811 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:36.851791    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb\": container with ID starting with 08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb not found: ID does not exist" containerID="08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"
Oct 30 11:35:36.851891 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.851822    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb"} err="failed to get container status \"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb\": rpc error: code = NotFound desc = could not find container \"08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb\": container with ID starting with 08e72dc0f4a9742d37939c8de5c75d69a9a08e950b1d265a20caee2c69bdfedb not found: ID does not exist"
Oct 30 11:35:36.893296 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.893275    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xttwj\" (UniqueName: \"kubernetes.io/projected/55c837f6-fba0-455a-827d-a4de8446028e-kube-api-access-xttwj\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:36.894597 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.894578    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:36.898777 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.898759    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-zzklp"]
Oct 30 11:35:36.994450 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.994423    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\" (UniqueName: \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\") pod \"b6efd006-27c2-44dd-8b6c-532aaa619ddf\" (UID: \"b6efd006-27c2-44dd-8b6c-532aaa619ddf\") "
Oct 30 11:35:36.997077 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:36.997045    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2" pod "b6efd006-27c2-44dd-8b6c-532aaa619ddf" (UID: "b6efd006-27c2-44dd-8b6c-532aaa619ddf"). InnerVolumeSpecName "kube-api-access-542b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:37.095859 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.095837    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-542b2\" (UniqueName: \"kubernetes.io/projected/b6efd006-27c2-44dd-8b6c-532aaa619ddf-kube-api-access-542b2\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.190979 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.190875    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:37.215534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.215502    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:37.215719 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.215665    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" podUID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" containerName="ta-container" containerID="cri-o://bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff" gracePeriod=30
Oct 30 11:35:37.324882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.324811    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:37.325076 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.325055    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" containerName="perses" containerID="cri-o://d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1" gracePeriod=30
Oct 30 11:35:37.446689 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.446664    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:37.571665 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.571642    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:37.601042 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.600984    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\") pod \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") "
Oct 30 11:35:37.601158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.601062    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\" (UniqueName: \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\") pod \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") "
Oct 30 11:35:37.601158 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.601133    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\" (UniqueName: \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\") pod \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\" (UID: \"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2\") "
Oct 30 11:35:37.601532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.601504    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal" pod "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" (UID: "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:37.603025 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.602983    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm" pod "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" (UID: "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2"). InnerVolumeSpecName "kube-api-access-tqtlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:37.603116 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.603031    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert" pod "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" (UID: "7d85e2c8-87fe-45ea-868f-eeea05c8c7b2"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:37.701670 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.701639    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\" (UniqueName: \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\") pod \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") "
Oct 30 11:35:37.701773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.701675    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\") pod \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") "
Oct 30 11:35:37.701773 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.701692    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\" (UniqueName: \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\") pod \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") "
Oct 30 11:35:37.701864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.701831    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\" (UID: \"a6487687-fccb-47cd-8521-f2d0a5cf5c82\") "
Oct 30 11:35:37.702060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.702041    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.702138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.702067    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqtlm\" (UniqueName: \"kubernetes.io/projected/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-kube-api-access-tqtlm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.702138 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.702082    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.702242 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.702157    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config" pod "a6487687-fccb-47cd-8521-f2d0a5cf5c82" (UID: "a6487687-fccb-47cd-8521-f2d0a5cf5c82"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:37.703795 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.703769    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m" pod "a6487687-fccb-47cd-8521-f2d0a5cf5c82" (UID: "a6487687-fccb-47cd-8521-f2d0a5cf5c82"). InnerVolumeSpecName "kube-api-access-p7x2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:37.704686 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.704665    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "a6487687-fccb-47cd-8521-f2d0a5cf5c82" (UID: "a6487687-fccb-47cd-8521-f2d0a5cf5c82"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:35:37.802560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.802532    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7x2m\" (UniqueName: \"kubernetes.io/projected/a6487687-fccb-47cd-8521-f2d0a5cf5c82-kube-api-access-p7x2m\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.802560 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.802561    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6487687-fccb-47cd-8521-f2d0a5cf5c82-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:37.802740 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.802597    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:35:37.803749 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.803723    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55c837f6-fba0-455a-827d-a4de8446028e" path="/var/lib/kubelet/pods/55c837f6-fba0-455a-827d-a4de8446028e/volumes"
Oct 30 11:35:37.816324 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.816307    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:35:37.848607 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.848580    4488 generic.go:356] "Generic (PLEG): container finished" podID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" containerID="bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff" exitCode=0
Oct 30 11:35:37.848980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.848644    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"
Oct 30 11:35:37.848980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.848661    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" event={"ID":"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2","Type":"ContainerDied","Data":"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"}
Oct 30 11:35:37.848980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.848700    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf" event={"ID":"7d85e2c8-87fe-45ea-868f-eeea05c8c7b2","Type":"ContainerDied","Data":"13ed10781ab2548038edba677f125a660dbc15b3d2beaa6e6e45f7d4b23afac1"}
Oct 30 11:35:37.848980 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.848716    4488 scope.go:122] "RemoveContainer" containerID="bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"
Oct 30 11:35:37.850083 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.850063    4488 generic.go:356] "Generic (PLEG): container finished" podID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" containerID="d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1" exitCode=0
Oct 30 11:35:37.850164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.850094    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a6487687-fccb-47cd-8521-f2d0a5cf5c82","Type":"ContainerDied","Data":"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"}
Oct 30 11:35:37.850164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.850115    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:37.850164 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.850132    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a6487687-fccb-47cd-8521-f2d0a5cf5c82","Type":"ContainerDied","Data":"194387d717b9002e0f05cef8021098bb4842007ae797ee9f3565cfafea382657"}
Oct 30 11:35:37.851443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.851393    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="8c4e008f-37ab-4b68-ad99-50981d43e81d" containerName="otc-container" containerID="cri-o://3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74" gracePeriod=30
Oct 30 11:35:37.851443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.851432    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"
Oct 30 11:35:37.858317 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.858295    4488 scope.go:122] "RemoveContainer" containerID="bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"
Oct 30 11:35:37.858635 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:37.858615    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff\": container with ID starting with bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff not found: ID does not exist" containerID="bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"
Oct 30 11:35:37.858800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.858643    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff"} err="failed to get container status \"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff\": rpc error: code = NotFound desc = could not find container \"bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff\": container with ID starting with bb1e872562066b088a079d5f18584fce9cdba31fd9c347577423339aacec7fff not found: ID does not exist"
Oct 30 11:35:37.858800 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.858659    4488 scope.go:122] "RemoveContainer" containerID="d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"
Oct 30 11:35:37.866270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.866251    4488 scope.go:122] "RemoveContainer" containerID="d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"
Oct 30 11:35:37.866673 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:37.866652    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1\": container with ID starting with d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1 not found: ID does not exist" containerID="d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"
Oct 30 11:35:37.866748 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.866679    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1"} err="failed to get container status \"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1\": rpc error: code = NotFound desc = could not find container \"d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1\": container with ID starting with d98d8e5190f0c66e69bf608d351af267ac0145befe522c8f5911b30f0e9164f1 not found: ID does not exist"
Oct 30 11:35:37.900718 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.900695    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:37.903559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.903539    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:35:37.904831 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.904812    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fd654f4cc-wswnf"]
Oct 30 11:35:37.979918 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.979888    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"]
Oct 30 11:35:37.983244 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.983221    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vnhcs"]
Oct 30 11:35:37.984785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:37.984764    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins" pod "a6487687-fccb-47cd-8521-f2d0a5cf5c82" (UID: "a6487687-fccb-47cd-8521-f2d0a5cf5c82"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:35:38.005016 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.004995    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a6487687-fccb-47cd-8521-f2d0a5cf5c82-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.127701 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.127672    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:38.207460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.207432    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\") pod \"8c4e008f-37ab-4b68-ad99-50981d43e81d\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") "
Oct 30 11:35:38.207460 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.207463    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\") pod \"8c4e008f-37ab-4b68-ad99-50981d43e81d\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") "
Oct 30 11:35:38.207735 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.207518    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\" (UniqueName: \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\") pod \"8c4e008f-37ab-4b68-ad99-50981d43e81d\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") "
Oct 30 11:35:38.207735 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.207553    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\" (UniqueName: \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\") pod \"8c4e008f-37ab-4b68-ad99-50981d43e81d\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") "
Oct 30 11:35:38.208098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.208069    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal" pod "8c4e008f-37ab-4b68-ad99-50981d43e81d" (UID: "8c4e008f-37ab-4b68-ad99-50981d43e81d"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:35:38.209516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.209491    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:38.210741 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.210718    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert" pod "8c4e008f-37ab-4b68-ad99-50981d43e81d" (UID: "8c4e008f-37ab-4b68-ad99-50981d43e81d"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:38.210830 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.210795    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs" pod "8c4e008f-37ab-4b68-ad99-50981d43e81d" (UID: "8c4e008f-37ab-4b68-ad99-50981d43e81d"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:38.210887 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.210859    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc" pod "8c4e008f-37ab-4b68-ad99-50981d43e81d" (UID: "8c4e008f-37ab-4b68-ad99-50981d43e81d"). InnerVolumeSpecName "kube-api-access-fhhlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:38.215272 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.215242    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:38.307890 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.307862    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\") pod \"8c4e008f-37ab-4b68-ad99-50981d43e81d\" (UID: \"8c4e008f-37ab-4b68-ad99-50981d43e81d\") "
Oct 30 11:35:38.308059 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.308045    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.308114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.308062    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.308114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.308071    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhhlc\" (UniqueName: \"kubernetes.io/projected/8c4e008f-37ab-4b68-ad99-50981d43e81d-kube-api-access-fhhlc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.308114 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.308081    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/8c4e008f-37ab-4b68-ad99-50981d43e81d-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.309729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.309708    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs" pod "8c4e008f-37ab-4b68-ad99-50981d43e81d" (UID: "8c4e008f-37ab-4b68-ad99-50981d43e81d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:35:38.408726 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.408672    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c4e008f-37ab-4b68-ad99-50981d43e81d-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:38.857356 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.857308    4488 generic.go:356] "Generic (PLEG): container finished" podID="8c4e008f-37ab-4b68-ad99-50981d43e81d" containerID="3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74" exitCode=0
Oct 30 11:35:38.857745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.857376    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:38.857745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.857373    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"8c4e008f-37ab-4b68-ad99-50981d43e81d","Type":"ContainerDied","Data":"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"}
Oct 30 11:35:38.857745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.857496    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"8c4e008f-37ab-4b68-ad99-50981d43e81d","Type":"ContainerDied","Data":"e3ff9bfa18ccb092995c89a8fad7c487b5bc4be2fc4d36c243e4797ebfbcd22d"}
Oct 30 11:35:38.857745 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.857519    4488 scope.go:122] "RemoveContainer" containerID="3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"
Oct 30 11:35:38.865845 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.865830    4488 scope.go:122] "RemoveContainer" containerID="3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"
Oct 30 11:35:38.866084 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:38.866066    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74\": container with ID starting with 3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74 not found: ID does not exist" containerID="3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"
Oct 30 11:35:38.866137 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.866091    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74"} err="failed to get container status \"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74\": rpc error: code = NotFound desc = could not find container \"3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74\": container with ID starting with 3615adb626d5795ebe05985f873eb30ceca81af2ddbd06e7c29aeb6423b5ef74 not found: ID does not exist"
Oct 30 11:35:38.911172 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.911151    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:38.914924 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:38.914905    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:39.802087 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:39.802053    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" path="/var/lib/kubelet/pods/7d85e2c8-87fe-45ea-868f-eeea05c8c7b2/volumes"
Oct 30 11:35:39.802452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:39.802437    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c4e008f-37ab-4b68-ad99-50981d43e81d" path="/var/lib/kubelet/pods/8c4e008f-37ab-4b68-ad99-50981d43e81d/volumes"
Oct 30 11:35:39.802810 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:39.802797    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" path="/var/lib/kubelet/pods/a6487687-fccb-47cd-8521-f2d0a5cf5c82/volumes"
Oct 30 11:35:39.803558 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:39.803539    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6efd006-27c2-44dd-8b6c-532aaa619ddf" path="/var/lib/kubelet/pods/b6efd006-27c2-44dd-8b6c-532aaa619ddf/volumes"
Oct 30 11:35:45.248165 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248130    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248451    4488 cpu_manager.go:414] "containerMap: removing container" podUID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" containerName="ta-container"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248465    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" containerName="ta-container"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248484    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" containerName="perses"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248490    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" containerName="perses"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248503    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8c4e008f-37ab-4b68-ad99-50981d43e81d" containerName="otc-container"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248509    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c4e008f-37ab-4b68-ad99-50981d43e81d" containerName="otc-container"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248520    4488 cpu_manager.go:414] "containerMap: removing container" podUID="55c837f6-fba0-455a-827d-a4de8446028e" containerName="thanos-querier"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248526    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55c837f6-fba0-455a-827d-a4de8446028e" containerName="thanos-querier"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248576    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="55c837f6-fba0-455a-827d-a4de8446028e" containerName="thanos-querier"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248584    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d85e2c8-87fe-45ea-868f-eeea05c8c7b2" containerName="ta-container"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248592    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6487687-fccb-47cd-8521-f2d0a5cf5c82" containerName="perses"
Oct 30 11:35:45.248633 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.248599    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c4e008f-37ab-4b68-ad99-50981d43e81d" containerName="otc-container"
Oct 30 11:35:45.252797 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.252770    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:45.268945 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.268920    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:45.272130 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.272106    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-kh8sh\""
Oct 30 11:35:45.281030 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.281012    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 11:35:45.285195 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.285178    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 11:35:45.350834 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.350811    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvsv\" (UniqueName: \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p\" (UID: \"a34f982e-bb10-4eb4-9d5c-05228657d714\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:45.451728 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.451704    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvsv\" (UniqueName: \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p\" (UID: \"a34f982e-bb10-4eb4-9d5c-05228657d714\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:45.476502 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.476480    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvsv\" (UniqueName: \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p\" (UID: \"a34f982e-bb10-4eb4-9d5c-05228657d714\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:45.563870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.563817    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:45.858608 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.858537    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:45.863738 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:45.863711    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda34f982e_bb10_4eb4_9d5c_05228657d714.slice/crio-03b76742ade77a0740727d87ec98fbcc2833d55394c3f818e0648e293316e9c1 WatchSource:0}: Error finding container 03b76742ade77a0740727d87ec98fbcc2833d55394c3f818e0648e293316e9c1: Status 404 returned error can't find the container with id 03b76742ade77a0740727d87ec98fbcc2833d55394c3f818e0648e293316e9c1
Oct 30 11:35:45.887458 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:45.887432    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" event={"ID":"a34f982e-bb10-4eb4-9d5c-05228657d714","Type":"ContainerStarted","Data":"03b76742ade77a0740727d87ec98fbcc2833d55394c3f818e0648e293316e9c1"}
Oct 30 11:35:46.221864 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.221827    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:46.225744 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.225722    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.245060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.245031    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:46.258007 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.257982    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcsck\" (UniqueName: \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.258443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.258037    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.258443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.258178    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.258443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.258233    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.258443 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.258330    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.265547 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.265525    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-e4cadd38\""
Oct 30 11:35:46.269140 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.269118    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:46.272705 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.272687    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.290453 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.290429    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:46.319635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.319614    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 11:35:46.322816 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.322798    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 11:35:46.322983 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.322963    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 11:35:46.323060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.322967    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 11:35:46.323060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.322970    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-84c64\""
Oct 30 11:35:46.340498 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.340478    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:35:46.347712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.347695    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.358712 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.358691    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.358867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.358730    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.358867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.358768    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.358867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.358788    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.358867 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.358839    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcsck\" (UniqueName: \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.359856 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.359830    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.362037 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.362015    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.362808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.362061    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.362808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.362131    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:35:46.362808 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.362416    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.382329 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.382310    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcsck\" (UniqueName: \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\") pod \"data-science-collector-collector-1\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.419784 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.419765    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 11:35:46.423392 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.423375    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-2675f\""
Oct 30 11:35:46.423493 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.423428    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 11:35:46.459799 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459780    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.459897 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459821    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.459942 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459922    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l8k7\" (UniqueName: \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.459984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459947    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.459984 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459965    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbv2f\" (UniqueName: \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.460061 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.459985    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.540032 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.539982    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:35:46.561312 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561289    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l8k7\" (UniqueName: \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.561425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561321    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.561425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561357    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbv2f\" (UniqueName: \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.561425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561390    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.561425 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561425    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.561629 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561485    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.561729 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.561708    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.562382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.562307    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.562382 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.562321    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.564508 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.564486    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.588863 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.588833    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l8k7\" (UniqueName: \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\") pod \"data-science-collector-targetallocator-76b7fbb9f4-gc4th\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.600279 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.600250    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbv2f\" (UniqueName: \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:46.658948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.658920    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:46.837239 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.837170    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:35:46.840751 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:46.840727    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c70fcb_e67c_4f2d_b90e_a810cfef58b7.slice/crio-f6045abcca565930f95ff72d75a7b2a613aaa5213710e0a2fd1a433a4ae7ca37 WatchSource:0}: Error finding container f6045abcca565930f95ff72d75a7b2a613aaa5213710e0a2fd1a433a4ae7ca37: Status 404 returned error can't find the container with id f6045abcca565930f95ff72d75a7b2a613aaa5213710e0a2fd1a433a4ae7ca37
Oct 30 11:35:46.842883 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.842850    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:46.842965 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.842909    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:46.893504 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.893447    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"64c70fcb-e67c-4f2d-b90e-a810cfef58b7","Type":"ContainerStarted","Data":"f6045abcca565930f95ff72d75a7b2a613aaa5213710e0a2fd1a433a4ae7ca37"}
Oct 30 11:35:46.895004 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.894985    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" event={"ID":"a34f982e-bb10-4eb4-9d5c-05228657d714","Type":"ContainerStarted","Data":"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"}
Oct 30 11:35:46.936120 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.936072    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" podStartSLOduration=1.936059647 podStartE2EDuration="1.936059647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:46.9356588 +0000 UTC m=+3043.281250655" watchObservedRunningTime="2026-10-30 11:35:46.936059647 +0000 UTC m=+3043.281651501"
Oct 30 11:35:46.956711 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.956681    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:35:46.961178 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:46.961150    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca64c0b_6c13_45c1_9aa8_01aaff5fa596.slice/crio-5c71be6e1835409cc2ed5657eb472c3f4947f082620c087450dd0d0724614983 WatchSource:0}: Error finding container 5c71be6e1835409cc2ed5657eb472c3f4947f082620c087450dd0d0724614983: Status 404 returned error can't find the container with id 5c71be6e1835409cc2ed5657eb472c3f4947f082620c087450dd0d0724614983
Oct 30 11:35:46.963825 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.963792    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:46.963917 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:46.963848    4488 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 11:35:47.900809 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:47.900766    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"64c70fcb-e67c-4f2d-b90e-a810cfef58b7","Type":"ContainerStarted","Data":"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"}
Oct 30 11:35:47.902321 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:47.902294    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" event={"ID":"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596","Type":"ContainerStarted","Data":"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"}
Oct 30 11:35:47.902428 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:47.902332    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" event={"ID":"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596","Type":"ContainerStarted","Data":"5c71be6e1835409cc2ed5657eb472c3f4947f082620c087450dd0d0724614983"}
Oct 30 11:35:47.953791 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:47.953750    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.953737985 podStartE2EDuration="1.953737985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:47.953415101 +0000 UTC m=+3044.299006956" watchObservedRunningTime="2026-10-30 11:35:47.953737985 +0000 UTC m=+3044.299329816"
Oct 30 11:35:47.995785 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:47.995741    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" podStartSLOduration=1.9957279030000001 podStartE2EDuration="1.995727903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:47.995224631 +0000 UTC m=+3044.340816485" watchObservedRunningTime="2026-10-30 11:35:47.995727903 +0000 UTC m=+3044.341319757"
Oct 30 11:35:48.746002 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.745973    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:35:48.749499 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.749482    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:35:48.767987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.767962    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:35:48.879477 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.879448    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ggdz\" (UniqueName: \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf\" (UID: \"97d04faa-382d-4375-9b66-59d87e0c6e6c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:35:48.906098 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.906074    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:48.907839 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.907823    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:35:48.980060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:48.980035    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ggdz\" (UniqueName: \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf\" (UID: \"97d04faa-382d-4375-9b66-59d87e0c6e6c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:35:49.004369 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.004292    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ggdz\" (UniqueName: \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf\" (UID: \"97d04faa-382d-4375-9b66-59d87e0c6e6c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:35:49.060879 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.060856    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:35:49.358870 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.358803    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:35:49.361966 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:49.361935    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97d04faa_382d_4375_9b66_59d87e0c6e6c.slice/crio-ccd5b79560f13061d8b89e557bf51fd0bb76c230c7e8ca2449e4f10fc3625812 WatchSource:0}: Error finding container ccd5b79560f13061d8b89e557bf51fd0bb76c230c7e8ca2449e4f10fc3625812: Status 404 returned error can't find the container with id ccd5b79560f13061d8b89e557bf51fd0bb76c230c7e8ca2449e4f10fc3625812
Oct 30 11:35:49.911554 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.911511    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" event={"ID":"97d04faa-382d-4375-9b66-59d87e0c6e6c","Type":"ContainerStarted","Data":"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"}
Oct 30 11:35:49.911998 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.911561    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" event={"ID":"97d04faa-382d-4375-9b66-59d87e0c6e6c","Type":"ContainerStarted","Data":"ccd5b79560f13061d8b89e557bf51fd0bb76c230c7e8ca2449e4f10fc3625812"}
Oct 30 11:35:49.952832 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.952783    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" podStartSLOduration=1.952758108 podStartE2EDuration="1.952758108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:49.951803512 +0000 UTC m=+3046.297395366" watchObservedRunningTime="2026-10-30 11:35:49.952758108 +0000 UTC m=+3046.298349961"
Oct 30 11:35:49.989039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.989006    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:49.989225 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:49.989189    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" podUID="a34f982e-bb10-4eb4-9d5c-05228657d714" containerName="thanos-querier" containerID="cri-o://e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52" gracePeriod=30
Oct 30 11:35:50.218429 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.218395    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:50.290530 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.290490    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\" (UniqueName: \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\") pod \"a34f982e-bb10-4eb4-9d5c-05228657d714\" (UID: \"a34f982e-bb10-4eb4-9d5c-05228657d714\") "
Oct 30 11:35:50.292465 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.292442    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv" pod "a34f982e-bb10-4eb4-9d5c-05228657d714" (UID: "a34f982e-bb10-4eb4-9d5c-05228657d714"). InnerVolumeSpecName "kube-api-access-gqvsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:35:50.392003 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.391975    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqvsv\" (UniqueName: \"kubernetes.io/projected/a34f982e-bb10-4eb4-9d5c-05228657d714-kube-api-access-gqvsv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:35:50.916849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.916756    4488 generic.go:356] "Generic (PLEG): container finished" podID="a34f982e-bb10-4eb4-9d5c-05228657d714" containerID="e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52" exitCode=0
Oct 30 11:35:50.916849 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.916807    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"
Oct 30 11:35:50.917408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.916848    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" event={"ID":"a34f982e-bb10-4eb4-9d5c-05228657d714","Type":"ContainerDied","Data":"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"}
Oct 30 11:35:50.917408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.916884    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p" event={"ID":"a34f982e-bb10-4eb4-9d5c-05228657d714","Type":"ContainerDied","Data":"03b76742ade77a0740727d87ec98fbcc2833d55394c3f818e0648e293316e9c1"}
Oct 30 11:35:50.917408 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.916901    4488 scope.go:122] "RemoveContainer" containerID="e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"
Oct 30 11:35:50.925732 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.925716    4488 scope.go:122] "RemoveContainer" containerID="e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"
Oct 30 11:35:50.925973 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:35:50.925956    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52\": container with ID starting with e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52 not found: ID does not exist" containerID="e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"
Oct 30 11:35:50.926039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.925980    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52"} err="failed to get container status \"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52\": rpc error: code = NotFound desc = could not find container \"e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52\": container with ID starting with e115f95e7f21746d54ca0c0d43ffbea954e90d4564fa8e524ba516b8494b2a52 not found: ID does not exist"
Oct 30 11:35:50.968802 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.968781    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:50.981544 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:50.981517    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-pdv5p"]
Oct 30 11:35:51.802325 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:51.802288    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a34f982e-bb10-4eb4-9d5c-05228657d714" path="/var/lib/kubelet/pods/a34f982e-bb10-4eb4-9d5c-05228657d714/volumes"
Oct 30 11:35:55.732183 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.732151    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.763110 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.763086    4488 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.833229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.833207    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.833377 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.833356    4488 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.849319 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.849296    4488 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.952610 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.952584    4488 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7a12ef52535859e737e7d4c350c6d93bcb646c38cebb63afeae237b46ab5f65d/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:55.983036 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:55.982984    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"data-science-perses-0\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:56.183678 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.183647    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:56.479426 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.479377    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:35:56.483550 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:35:56.483493    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf770b711_a84c_4183_8086_2dc882a5a60b.slice/crio-ef92dfd9975f5854c0b60ceb0652c98e9a87303ab17013f95076a781dd948105 WatchSource:0}: Error finding container ef92dfd9975f5854c0b60ceb0652c98e9a87303ab17013f95076a781dd948105: Status 404 returned error can't find the container with id ef92dfd9975f5854c0b60ceb0652c98e9a87303ab17013f95076a781dd948105
Oct 30 11:35:56.944258 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.944223    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f770b711-a84c-4183-8086-2dc882a5a60b","Type":"ContainerStarted","Data":"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"}
Oct 30 11:35:56.944662 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.944264    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f770b711-a84c-4183-8086-2dc882a5a60b","Type":"ContainerStarted","Data":"ef92dfd9975f5854c0b60ceb0652c98e9a87303ab17013f95076a781dd948105"}
Oct 30 11:35:56.944662 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.944304    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:35:56.994463 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:35:56.994398    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=10.994380416 podStartE2EDuration="10.994380416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:35:56.994192527 +0000 UTC m=+3053.339784410" watchObservedRunningTime="2026-10-30 11:35:56.994380416 +0000 UTC m=+3053.339972273"
Oct 30 11:36:01.477759 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:01.477722    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:36:07.950617 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:07.950591    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:36:16.105068 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.105018    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:36:16.105801 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.105769    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" podUID="97d04faa-382d-4375-9b66-59d87e0c6e6c" containerName="thanos-querier" containerID="cri-o://9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83" gracePeriod=30
Oct 30 11:36:16.362774 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.362706    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:36:16.380747 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.380721    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\" (UniqueName: \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\") pod \"97d04faa-382d-4375-9b66-59d87e0c6e6c\" (UID: \"97d04faa-382d-4375-9b66-59d87e0c6e6c\") "
Oct 30 11:36:16.382674 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.382649    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz" pod "97d04faa-382d-4375-9b66-59d87e0c6e6c" (UID: "97d04faa-382d-4375-9b66-59d87e0c6e6c"). InnerVolumeSpecName "kube-api-access-5ggdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:36:16.481197 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.481164    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ggdz\" (UniqueName: \"kubernetes.io/projected/97d04faa-382d-4375-9b66-59d87e0c6e6c-kube-api-access-5ggdz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:16.959039 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.959007    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:36:16.959229 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:16.959208    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" containerName="otc-container" containerID="cri-o://893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b" gracePeriod=30
Oct 30 11:36:17.000452 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.000422    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:36:17.000651 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.000629    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" podUID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" containerName="ta-container" containerID="cri-o://50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92" gracePeriod=30
Oct 30 11:36:17.024779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.024740    4488 generic.go:356] "Generic (PLEG): container finished" podID="97d04faa-382d-4375-9b66-59d87e0c6e6c" containerID="9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83" exitCode=0
Oct 30 11:36:17.024962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.024794    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"
Oct 30 11:36:17.024962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.024860    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" event={"ID":"97d04faa-382d-4375-9b66-59d87e0c6e6c","Type":"ContainerDied","Data":"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"}
Oct 30 11:36:17.024962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.024921    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf" event={"ID":"97d04faa-382d-4375-9b66-59d87e0c6e6c","Type":"ContainerDied","Data":"ccd5b79560f13061d8b89e557bf51fd0bb76c230c7e8ca2449e4f10fc3625812"}
Oct 30 11:36:17.024962 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.024942    4488 scope.go:122] "RemoveContainer" containerID="9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"
Oct 30 11:36:17.111069 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.111047    4488 scope.go:122] "RemoveContainer" containerID="9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"
Oct 30 11:36:17.111650 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:17.111448    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83\": container with ID starting with 9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83 not found: ID does not exist" containerID="9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"
Oct 30 11:36:17.111650 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.111484    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83"} err="failed to get container status \"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83\": rpc error: code = NotFound desc = could not find container \"9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83\": container with ID starting with 9b009a879ac13ce7adb3d4160154e2d2792e04fff467fc7aabb6092abde79f83 not found: ID does not exist"
Oct 30 11:36:17.154992 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.154952    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:36:17.163246 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.163217    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-jpdnf"]
Oct 30 11:36:17.189653 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.189622    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:36:17.189900 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.189858    4488 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="f770b711-a84c-4183-8086-2dc882a5a60b" containerName="perses" containerID="cri-o://67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b" gracePeriod=30
Oct 30 11:36:17.310156 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.310128    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:36:17.313833 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.313808    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:36:17.388858 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.388819    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\") pod \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") "
Oct 30 11:36:17.389078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.388903    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\") pod \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") "
Oct 30 11:36:17.389078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.388938    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\" (UniqueName: \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\") pod \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") "
Oct 30 11:36:17.389078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389004    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\") pod \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") "
Oct 30 11:36:17.389078 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389052    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\") pod \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") "
Oct 30 11:36:17.389378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389093    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\") pod \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") "
Oct 30 11:36:17.389378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389124    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\" (UniqueName: \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\") pod \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\" (UID: \"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596\") "
Oct 30 11:36:17.389378 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389194    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\" (UniqueName: \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\") pod \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\" (UID: \"64c70fcb-e67c-4f2d-b90e-a810cfef58b7\") "
Oct 30 11:36:17.389618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389592    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal" pod "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" (UID: "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:36:17.390024 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.389994    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal" pod "64c70fcb-e67c-4f2d-b90e-a810cfef58b7" (UID: "64c70fcb-e67c-4f2d-b90e-a810cfef58b7"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:36:17.393292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.393242    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs" pod "64c70fcb-e67c-4f2d-b90e-a810cfef58b7" (UID: "64c70fcb-e67c-4f2d-b90e-a810cfef58b7"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:36:17.393292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.393265    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert" pod "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" (UID: "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:36:17.393292 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.393270    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs" pod "64c70fcb-e67c-4f2d-b90e-a810cfef58b7" (UID: "64c70fcb-e67c-4f2d-b90e-a810cfef58b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:36:17.393581 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.393313    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert" pod "64c70fcb-e67c-4f2d-b90e-a810cfef58b7" (UID: "64c70fcb-e67c-4f2d-b90e-a810cfef58b7"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 11:36:17.394248 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.394219    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7" pod "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" (UID: "8ca64c0b-6c13-45c1-9aa8-01aaff5fa596"). InnerVolumeSpecName "kube-api-access-8l8k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:36:17.395095 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.395067    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck" pod "64c70fcb-e67c-4f2d-b90e-a810cfef58b7" (UID: "64c70fcb-e67c-4f2d-b90e-a810cfef58b7"). InnerVolumeSpecName "kube-api-access-jcsck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:36:17.433534 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.433510    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:36:17.489835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.489752    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\" (UniqueName: \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\") pod \"f770b711-a84c-4183-8086-2dc882a5a60b\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") "
Oct 30 11:36:17.489835 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.489811    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\" (UniqueName: \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\") pod \"f770b711-a84c-4183-8086-2dc882a5a60b\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") "
Oct 30 11:36:17.490062 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.489951    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") pod \"f770b711-a84c-4183-8086-2dc882a5a60b\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") "
Oct 30 11:36:17.490062 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490026    4488 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\") pod \"f770b711-a84c-4183-8086-2dc882a5a60b\" (UID: \"f770b711-a84c-4183-8086-2dc882a5a60b\") "
Oct 30 11:36:17.490179 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490101    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config" pod "f770b711-a84c-4183-8086-2dc882a5a60b" (UID: "f770b711-a84c-4183-8086-2dc882a5a60b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490334    4488 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490385    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-data-science-collector-ta-server-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490408    4488 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f770b711-a84c-4183-8086-2dc882a5a60b-config\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490422    4488 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-ta-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490438    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l8k7\" (UniqueName: \"kubernetes.io/projected/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596-kube-api-access-8l8k7\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490451    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcsck\" (UniqueName: \"kubernetes.io/projected/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-kube-api-access-jcsck\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490466    4488 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-data-science-collector-ta-client-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490480    4488 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-monitoring-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.490516 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.490494    4488 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/64c70fcb-e67c-4f2d-b90e-a810cfef58b7-otc-internal\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.492223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.492200    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f" pod "f770b711-a84c-4183-8086-2dc882a5a60b" (UID: "f770b711-a84c-4183-8086-2dc882a5a60b"). InnerVolumeSpecName "kube-api-access-dbv2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 11:36:17.492613 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.492591    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab" pod "f770b711-a84c-4183-8086-2dc882a5a60b" (UID: "f770b711-a84c-4183-8086-2dc882a5a60b"). InnerVolumeSpecName "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 11:36:17.591559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.591526    4488 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" "
Oct 30 11:36:17.591559 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.591559    4488 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbv2f\" (UniqueName: \"kubernetes.io/projected/f770b711-a84c-4183-8086-2dc882a5a60b-kube-api-access-dbv2f\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.605459 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.605442    4488 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab") on node "ip-10-0-132-202.ec2.internal"
Oct 30 11:36:17.639663 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.639641    4488 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins" pod "f770b711-a84c-4183-8086-2dc882a5a60b" (UID: "f770b711-a84c-4183-8086-2dc882a5a60b"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 11:36:17.692521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.692496    4488 reconciler_common.go:299] "Volume detached for volume \"pvc-88bb6e47-3c0a-486d-85ae-b5584dc14bbf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a9d3f3eaabbd88ab\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"csi-c84b00752fc89c94f6328452e6d1c3ce19fbc2b54c38c16933d87ec4d11dfb41\""
Oct 30 11:36:17.692521 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.692519    4488 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f770b711-a84c-4183-8086-2dc882a5a60b-plugins\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Oct 30 11:36:17.802226 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:17.802169    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97d04faa-382d-4375-9b66-59d87e0c6e6c" path="/var/lib/kubelet/pods/97d04faa-382d-4375-9b66-59d87e0c6e6c/volumes"
Oct 30 11:36:18.030986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.030925    4488 generic.go:356] "Generic (PLEG): container finished" podID="f770b711-a84c-4183-8086-2dc882a5a60b" containerID="67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b" exitCode=0
Oct 30 11:36:18.030986 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.030965    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f770b711-a84c-4183-8086-2dc882a5a60b","Type":"ContainerDied","Data":"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"}
Oct 30 11:36:18.031268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.031031    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f770b711-a84c-4183-8086-2dc882a5a60b","Type":"ContainerDied","Data":"ef92dfd9975f5854c0b60ceb0652c98e9a87303ab17013f95076a781dd948105"}
Oct 30 11:36:18.031268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.030982    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 11:36:18.031268 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.031057    4488 scope.go:122] "RemoveContainer" containerID="67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"
Oct 30 11:36:18.032836 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.032810    4488 generic.go:356] "Generic (PLEG): container finished" podID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" containerID="893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b" exitCode=0
Oct 30 11:36:18.032963 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.032948    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 11:36:18.033253 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.033225    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"64c70fcb-e67c-4f2d-b90e-a810cfef58b7","Type":"ContainerDied","Data":"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"}
Oct 30 11:36:18.033393 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.033279    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"64c70fcb-e67c-4f2d-b90e-a810cfef58b7","Type":"ContainerDied","Data":"f6045abcca565930f95ff72d75a7b2a613aaa5213710e0a2fd1a433a4ae7ca37"}
Oct 30 11:36:18.034901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.034880    4488 generic.go:356] "Generic (PLEG): container finished" podID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" containerID="50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92" exitCode=0
Oct 30 11:36:18.035028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.034908    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" event={"ID":"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596","Type":"ContainerDied","Data":"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"}
Oct 30 11:36:18.035028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.034939    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th" event={"ID":"8ca64c0b-6c13-45c1-9aa8-01aaff5fa596","Type":"ContainerDied","Data":"5c71be6e1835409cc2ed5657eb472c3f4947f082620c087450dd0d0724614983"}
Oct 30 11:36:18.035028 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.034939    4488 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"
Oct 30 11:36:18.041625 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.041599    4488 scope.go:122] "RemoveContainer" containerID="67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"
Oct 30 11:36:18.041903 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:18.041872    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b\": container with ID starting with 67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b not found: ID does not exist" containerID="67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"
Oct 30 11:36:18.042010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.041906    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b"} err="failed to get container status \"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b\": rpc error: code = NotFound desc = could not find container \"67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b\": container with ID starting with 67a5d93ce4b2898053e495c5ae87b7f922f3c47301f64a111529b158a21e428b not found: ID does not exist"
Oct 30 11:36:18.042010 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.041925    4488 scope.go:122] "RemoveContainer" containerID="893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"
Oct 30 11:36:18.056388 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.056135    4488 scope.go:122] "RemoveContainer" containerID="893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"
Oct 30 11:36:18.056796 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:18.056770    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b\": container with ID starting with 893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b not found: ID does not exist" containerID="893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"
Oct 30 11:36:18.056888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.056804    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b"} err="failed to get container status \"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b\": rpc error: code = NotFound desc = could not find container \"893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b\": container with ID starting with 893a85a3222783693787e1329559059fe62937bbdaceb001814fb4f95daaac5b not found: ID does not exist"
Oct 30 11:36:18.056888 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.056826    4488 scope.go:122] "RemoveContainer" containerID="50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"
Oct 30 11:36:18.065803 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.065784    4488 scope.go:122] "RemoveContainer" containerID="50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"
Oct 30 11:36:18.066056 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:18.066040    4488 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92\": container with ID starting with 50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92 not found: ID does not exist" containerID="50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"
Oct 30 11:36:18.066126 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.066062    4488 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92"} err="failed to get container status \"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92\": rpc error: code = NotFound desc = could not find container \"50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92\": container with ID starting with 50dc053ab3294cbd31e693dfc83d3f261933bbaab687ca0ec81a3739b0498a92 not found: ID does not exist"
Oct 30 11:36:18.093599 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.093553    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:36:18.103223 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.103203    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76b7fbb9f4-gc4th"]
Oct 30 11:36:18.145932 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.145904    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:36:18.153060 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.153034    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 11:36:18.206111 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.206082    4488 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:36:18.252528 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:18.252500    4488 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 11:36:19.801739 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:19.801711    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" path="/var/lib/kubelet/pods/64c70fcb-e67c-4f2d-b90e-a810cfef58b7/volumes"
Oct 30 11:36:19.802139 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:19.802061    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" path="/var/lib/kubelet/pods/8ca64c0b-6c13-45c1-9aa8-01aaff5fa596/volumes"
Oct 30 11:36:19.802444 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:19.802430    4488 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f770b711-a84c-4183-8086-2dc882a5a60b" path="/var/lib/kubelet/pods/f770b711-a84c-4183-8086-2dc882a5a60b/volumes"
Oct 30 11:36:31.477987 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:36:31.477949    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"
Oct 30 11:36:32.061994 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.061958    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tgn5g/must-gather-fz85s"]
Oct 30 11:36:32.062372 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062356    4488 cpu_manager.go:414] "containerMap: removing container" podUID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" containerName="otc-container"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062373    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" containerName="otc-container"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062398    4488 cpu_manager.go:414] "containerMap: removing container" podUID="97d04faa-382d-4375-9b66-59d87e0c6e6c" containerName="thanos-querier"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062406    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97d04faa-382d-4375-9b66-59d87e0c6e6c" containerName="thanos-querier"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062412    4488 cpu_manager.go:414] "containerMap: removing container" podUID="f770b711-a84c-4183-8086-2dc882a5a60b" containerName="perses"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062417    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f770b711-a84c-4183-8086-2dc882a5a60b" containerName="perses"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062427    4488 cpu_manager.go:414] "containerMap: removing container" podUID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" containerName="ta-container"
Oct 30 11:36:32.062442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062432    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" containerName="ta-container"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062449    4488 cpu_manager.go:414] "containerMap: removing container" podUID="a34f982e-bb10-4eb4-9d5c-05228657d714" containerName="thanos-querier"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062454    4488 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a34f982e-bb10-4eb4-9d5c-05228657d714" containerName="thanos-querier"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062520    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c70fcb-e67c-4f2d-b90e-a810cfef58b7" containerName="otc-container"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062527    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="97d04faa-382d-4375-9b66-59d87e0c6e6c" containerName="thanos-querier"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062533    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="f770b711-a84c-4183-8086-2dc882a5a60b" containerName="perses"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062542    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ca64c0b-6c13-45c1-9aa8-01aaff5fa596" containerName="ta-container"
Oct 30 11:36:32.062661 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.062553    4488 memory_manager.go:365] "RemoveStaleState removing state" podUID="a34f982e-bb10-4eb4-9d5c-05228657d714" containerName="thanos-querier"
Oct 30 11:36:32.067011 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.066993    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.082706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.082682    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tgn5g/must-gather-fz85s"]
Oct 30 11:36:32.091290 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.091270    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c821ec81-732d-48f3-a2de-5fc70f7aeeae-must-gather-output\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.091467 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.091322    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsd55\" (UniqueName: \"kubernetes.io/projected/c821ec81-732d-48f3-a2de-5fc70f7aeeae-kube-api-access-gsd55\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.094390 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.094364    4488 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tgn5g\"/\"default-dockercfg-qskz5\""
Oct 30 11:36:32.094500 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.094402    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tgn5g\"/\"kube-root-ca.crt\""
Oct 30 11:36:32.095442 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.095426    4488 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tgn5g\"/\"openshift-service-ca.crt\""
Oct 30 11:36:32.191767 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.191744    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsd55\" (UniqueName: \"kubernetes.io/projected/c821ec81-732d-48f3-a2de-5fc70f7aeeae-kube-api-access-gsd55\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.191868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.191788    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c821ec81-732d-48f3-a2de-5fc70f7aeeae-must-gather-output\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.192147 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.192131    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c821ec81-732d-48f3-a2de-5fc70f7aeeae-must-gather-output\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.215868 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.215844    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsd55\" (UniqueName: \"kubernetes.io/projected/c821ec81-732d-48f3-a2de-5fc70f7aeeae-kube-api-access-gsd55\") pod \"must-gather-fz85s\" (UID: \"c821ec81-732d-48f3-a2de-5fc70f7aeeae\") " pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.380204 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.380143    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tgn5g/must-gather-fz85s"
Oct 30 11:36:32.675561 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.675531    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tgn5g/must-gather-fz85s"]
Oct 30 11:36:32.679260 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:36:32.679234    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc821ec81_732d_48f3_a2de_5fc70f7aeeae.slice/crio-3a8788e98fef195ca38016ab23a1e777df6ecba2a69901321211780bbd498a6d WatchSource:0}: Error finding container 3a8788e98fef195ca38016ab23a1e777df6ecba2a69901321211780bbd498a6d: Status 404 returned error can't find the container with id 3a8788e98fef195ca38016ab23a1e777df6ecba2a69901321211780bbd498a6d
Oct 30 11:36:32.681496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:32.681480    4488 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 11:36:33.095635 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:33.095552    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tgn5g/must-gather-fz85s" event={"ID":"c821ec81-732d-48f3-a2de-5fc70f7aeeae","Type":"ContainerStarted","Data":"3a8788e98fef195ca38016ab23a1e777df6ecba2a69901321211780bbd498a6d"}
Oct 30 11:36:34.103972 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:34.103933    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tgn5g/must-gather-fz85s" event={"ID":"c821ec81-732d-48f3-a2de-5fc70f7aeeae","Type":"ContainerStarted","Data":"34c2d3331c8866d320e0ef7a5ee9da2409cb38e01e78314df0fc3be1b8388bc0"}
Oct 30 11:36:34.104496 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:34.103984    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tgn5g/must-gather-fz85s" event={"ID":"c821ec81-732d-48f3-a2de-5fc70f7aeeae","Type":"ContainerStarted","Data":"a9568facd3240e8062ed6f8faf3677eb328bf6c8c13f35b452e363249427b734"}
Oct 30 11:36:34.146616 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:34.146557    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-tgn5g/must-gather-fz85s" podStartSLOduration=1.331787703 podStartE2EDuration="2.146543554s" totalImagesPullingTime="814.755851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 11:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:36:34.1457746 +0000 UTC m=+3090.491366456" watchObservedRunningTime="2026-10-30 11:36:34.146543554 +0000 UTC m=+3090.492135408"
Oct 30 11:36:36.334779 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:36.334739    4488 ???:1] "http2: server: error reading preface from client 10.0.140.230:43842: read tcp 10.0.132.202:10250->10.0.140.230:43842: read: connection reset by peer"
Oct 30 11:36:36.349882 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:36.349857    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-25rss_b60d4b1b-34df-469b-aa6b-502402acc947/global-pull-secret-syncer/0.log"
Oct 30 11:36:37.609901 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:37.609870    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-llcdz_b0e60f44-aa7a-4f52-b343-cfd031e269a7/konnectivity-agent/0.log"
Oct 30 11:36:37.893351 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:37.888864    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-202.ec2.internal_be533252ce0dba51bc9516009d3c38bb/haproxy/0.log"
Oct 30 11:36:42.883683 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:42.883587    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/alertmanager/0.log"
Oct 30 11:36:43.015364 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.014628    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/config-reloader/0.log"
Oct 30 11:36:43.139405 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.139153    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/kube-rbac-proxy-web/0.log"
Oct 30 11:36:43.282706 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.282197    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/kube-rbac-proxy/0.log"
Oct 30 11:36:43.415410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.415082    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/kube-rbac-proxy-metric/0.log"
Oct 30 11:36:43.555067 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.555039    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/prom-label-proxy/0.log"
Oct 30 11:36:43.682372 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.682282    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5b08ff0-69bd-4288-b9d9-b64326829458/init-config-reloader/0.log"
Oct 30 11:36:43.959352 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:43.959268    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8fnmk_c870f68c-3566-4fd5-bf67-7ac91ea4d8e9/kube-state-metrics/0.log"
Oct 30 11:36:44.091997 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:44.091971    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8fnmk_c870f68c-3566-4fd5-bf67-7ac91ea4d8e9/kube-rbac-proxy-main/0.log"
Oct 30 11:36:44.228410 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:44.228319    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8fnmk_c870f68c-3566-4fd5-bf67-7ac91ea4d8e9/kube-rbac-proxy-self/0.log"
Oct 30 11:36:44.632618 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:44.632543    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6fp27_380d1ab7-6b27-467f-b125-32670d5604e5/node-exporter/0.log"
Oct 30 11:36:44.759361 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:44.758888    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6fp27_380d1ab7-6b27-467f-b125-32670d5604e5/kube-rbac-proxy/0.log"
Oct 30 11:36:44.889696 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:44.889624    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6fp27_380d1ab7-6b27-467f-b125-32670d5604e5/init-textfile/0.log"
Oct 30 11:36:45.137023 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.136989    4488 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"]
Oct 30 11:36:45.143219 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.143151    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.159586 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.159562    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"]
Oct 30 11:36:45.297710 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.297676    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-proc\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.297915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.297720    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-sys\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.297915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.297819    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-lib-modules\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.297915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.297877    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2gvn\" (UniqueName: \"kubernetes.io/projected/05fb02b2-0387-4c27-ba95-332ba95fde9a-kube-api-access-k2gvn\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.298061 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.297947    4488 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-podres\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398623    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-proc\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398708 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398671    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-sys\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398717    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-lib-modules\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398758    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2gvn\" (UniqueName: \"kubernetes.io/projected/05fb02b2-0387-4c27-ba95-332ba95fde9a-kube-api-access-k2gvn\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398766    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-proc\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398784    4488 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-podres\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398826    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-sys\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398846    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-lib-modules\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.398948 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.398880    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05fb02b2-0387-4c27-ba95-332ba95fde9a-podres\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.423987 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.423943    4488 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2gvn\" (UniqueName: \"kubernetes.io/projected/05fb02b2-0387-4c27-ba95-332ba95fde9a-kube-api-access-k2gvn\") pod \"perf-node-gather-daemonset-jmjmx\" (UID: \"05fb02b2-0387-4c27-ba95-332ba95fde9a\") " pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.458915 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.458880    4488 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:45.768270 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:45.768185    4488 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"]
Oct 30 11:36:45.771622 ip-10-0-132-202 kubenswrapper[4488]: W1030 11:36:45.771594    4488 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05fb02b2_0387_4c27_ba95_332ba95fde9a.slice/crio-0c17a0c778ff074a593af3f33a9d46574488bcb3d3a0c5f3338bc5d03292bee4 WatchSource:0}: Error finding container 0c17a0c778ff074a593af3f33a9d46574488bcb3d3a0c5f3338bc5d03292bee4: Status 404 returned error can't find the container with id 0c17a0c778ff074a593af3f33a9d46574488bcb3d3a0c5f3338bc5d03292bee4
Oct 30 11:36:46.192289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.192214    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx" event={"ID":"05fb02b2-0387-4c27-ba95-332ba95fde9a","Type":"ContainerStarted","Data":"5d8f8d5e469e6ef5c581894d81d1acf0b3623962487353583cf8c1f7253a33cf"}
Oct 30 11:36:46.192289 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.192270    4488 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx" event={"ID":"05fb02b2-0387-4c27-ba95-332ba95fde9a","Type":"ContainerStarted","Data":"0c17a0c778ff074a593af3f33a9d46574488bcb3d3a0c5f3338bc5d03292bee4"}
Oct 30 11:36:46.192727 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.192397    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:46.197973 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.197946    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/prometheus/0.log"
Oct 30 11:36:46.239362 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.236460    4488 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx" podStartSLOduration=1.236440022 podStartE2EDuration="1.236440022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 11:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 11:36:46.235003224 +0000 UTC m=+3102.580595080" watchObservedRunningTime="2026-10-30 11:36:46.236440022 +0000 UTC m=+3102.582031879"
Oct 30 11:36:46.321587 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.321543    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/config-reloader/0.log"
Oct 30 11:36:46.463261 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.463187    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/thanos-sidecar/0.log"
Oct 30 11:36:46.589688 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.589661    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/kube-rbac-proxy-web/0.log"
Oct 30 11:36:46.713834 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.713748    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/kube-rbac-proxy/0.log"
Oct 30 11:36:46.836586 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.836555    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/kube-rbac-proxy-thanos/0.log"
Oct 30 11:36:46.962532 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:46.962486    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24b9a44c-90ee-44b5-be89-4bdebddc63ba/init-config-reloader/0.log"
Oct 30 11:36:47.104491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:47.104410    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-hrf4f_9a61a4d7-422b-4728-825f-7a370b43b2ec/prometheus-operator/0.log"
Oct 30 11:36:47.233431 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:47.233402    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-hrf4f_9a61a4d7-422b-4728-825f-7a370b43b2ec/kube-rbac-proxy/0.log"
Oct 30 11:36:52.206491 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:52.206460    4488 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tgn5g/perf-node-gather-daemonset-jmjmx"
Oct 30 11:36:55.726497 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:55.726464    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sn9kw_df1ca007-90f9-4966-b846-b7ef1185b06c/dns/0.log"
Oct 30 11:36:55.853447 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:55.853410    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sn9kw_df1ca007-90f9-4966-b846-b7ef1185b06c/kube-rbac-proxy/0.log"
Oct 30 11:36:56.263124 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:56.263098    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m42hf_76e63fa6-26d3-4247-96ff-15abbb584b6a/dns-node-resolver/0.log"
Oct 30 11:36:57.524122 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:36:57.524091    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pzbfk_0eabd736-4d90-410f-bc80-ff82deb9f1d4/node-ca/0.log"
Oct 30 11:37:00.681989 ip-10-0-132-202 kubenswrapper[4488]: I1030 11:37:00.681960    4488 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mk6zq_e09c17dd-ed06-461b-9cdc-d2ad16557bbc/serve-healthcheck-canary/0.log"
Oct 30 11:37:01.483367 ip-10-0-132-202 kubenswrapper[4488]: E1030 11:37:01.483321    4488 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dpvzb" containerName="extractor"