Jul 09 12:22:32.637838 ip-10-0-140-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 12:22:32.637849 ip-10-0-140-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 12:22:32.637856 ip-10-0-140-238 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 12:22:32.638066 ip-10-0-140-238 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 12:22:42.658940 ip-10-0-140-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 12:22:42.658955 ip-10-0-140-238 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 14699b2c65cb47dda15bb83a671d47a2 --
Jul 09 12:24:43.892783 ip-10-0-140-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.285031    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291281    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291296    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291300    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291303    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291307    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291309    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291313    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.347316 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291315    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291321    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291326    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291329    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291332    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291335    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291338    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291341    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291344    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291347    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291350    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291355    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291357    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291360    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291362    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291365    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291367    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291370    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291372    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.348448 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291375    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291378    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291380    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291382    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291385    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291387    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291390    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291392    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291395    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291397    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291400    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291404    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291409    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291411    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291414    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291418    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291421    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291424    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291427    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.349064 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291429    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291432    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291435    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291438    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291441    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291443    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291446    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291449    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291451    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291454    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291456    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291459    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291462    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291464    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291468    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291472    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291475    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291477    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291480    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291482    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.487396 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291486    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.357438 ip-10-0-140-238 systemd[1]: Started Kubernetes Kubelet.
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291489    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291491    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291494    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291497    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291499    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291502    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291505    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291522    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291524    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291527    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291530    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291533    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291536    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291538    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291541    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291543    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291547    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291550    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291552    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.497282 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291555    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291557    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291560    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291562    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291565    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291567    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291570    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291573    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291575    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291578    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291580    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291584    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291586    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.291589    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292292    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292298    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292301    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292304    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292307    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292311    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.498107 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292314    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292316    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292319    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292321    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292324    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292327    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292329    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292332    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292335    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292338    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292340    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292343    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292346    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292349    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292351    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292354    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292356    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292359    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292362    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292364    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.498871 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292368    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292370    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292374    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292379    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292382    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292386    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292390    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292393    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292396    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292400    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292403    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292406    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292409    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292412    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292415    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292418    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292421    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292423    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292426    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292429    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.499565 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292433    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292436    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292438    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292441    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292443    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292446    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292448    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292451    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292453    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292456    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292458    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292461    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292463    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292466    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292468    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292473    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292476    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292478    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292481    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292483    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.500275 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292486    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292488    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292491    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292495    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292499    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292502    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292505    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292523    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292527    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292531    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292533    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292536    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292538    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292541    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292543    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292546    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292548    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292551    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292553    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.500970 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292556    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292559    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292562    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292564    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292567    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292569    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292572    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292575    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292579    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292582    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292584    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292587    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292590    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.292592    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293424    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293431    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293434    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293437    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293442    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.501665 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293446    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293449    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293452    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293455    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293458    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293461    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293464    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293466    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293469    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293472    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293474    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293477    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293479    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293484    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293487    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293489    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293492    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293495    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293498    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.502302 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293501    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293504    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293522    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293525    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293527    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293530    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293533    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293536    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293539    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293541    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293544    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293546    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293549    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293552    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293554    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293557    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293559    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293562    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293564    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.502989 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293567    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293569    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293573    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293575    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293578    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293580    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293583    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293587    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293589    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293592    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293594    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293597    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293599    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293601    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293604    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293608    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293610    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293615    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293618    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293621    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.503654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293624    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293627    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293629    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293632    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293635    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293637    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293640    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293643    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293645    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293647    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293650    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293652    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293655    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293657    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293659    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293662    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293665    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293667    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293670    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293675    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.504485 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293677    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293680    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293682    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293685    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293687    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293689    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293692    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293696    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293698    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293701    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293703    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293706    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293708    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293711    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293713    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.293716    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293812    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293819    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293826    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293830    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293835    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293839    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 12:24:44.505168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293843    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293848    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293851    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293854    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293858    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293861    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293864    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293867    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293870    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293874    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293877    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293880    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293884    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293887    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293890    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293893    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293897    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293902    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293905    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293908    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293911    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293914    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293917    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293921    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 12:24:44.505857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293925    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293928    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293932    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293935    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293938    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293941    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293944    2573 flags.go:64] FLAG: --enable-server="true"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293947    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293952    2573 flags.go:64] FLAG: --event-burst="100"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293955    2573 flags.go:64] FLAG: --event-qps="50"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293958    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293962    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293964    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293968    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293971    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293974    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293977    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293981    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293984    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293987    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293989    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293992    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293995    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.293998    2573 flags.go:64] FLAG: --feature-gates=""
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294002    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 12:24:44.506531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294014    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294018    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294022    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294025    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294028    2573 flags.go:64] FLAG: --help="false"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294031    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294034    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294037    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294040    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294043    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294047    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294049    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294052    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294055    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294058    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294061    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294065    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294067    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294070    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294073    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294076    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294079    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294082    2573 flags.go:64] FLAG: --lock-file=""
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294085    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 12:24:44.507307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294089    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294092    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294098    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294101    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294104    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294107    2573 flags.go:64] FLAG: --logging-format="text"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294110    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294113    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294117    2573 flags.go:64] FLAG: --manifest-url=""
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294120    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294125    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294128    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294131    2573 flags.go:64] FLAG: --max-pods="110"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294134    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294137    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294140    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294143    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294146    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294149    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294152    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294159    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294162    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294165    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 12:24:44.508129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294168    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294172    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294178    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294181    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294184    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294187    2573 flags.go:64] FLAG: --port="10250"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294190    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294193    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05f7e05bb684b0035"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294196    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294201    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294203    2573 flags.go:64] FLAG: --register-node="true"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294206    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294210    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294213    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294215    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294218    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294222    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294225    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294230    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294233    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294236    2573 flags.go:64] FLAG: --runonce="false"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294239    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294242    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294245    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294248    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 12:24:44.508857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294250    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294253    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294256    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294259    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294262    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294265    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294268    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294270    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294274    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294277    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294280    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294285    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294288    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294291    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294295    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294298    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294301    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294304    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294307    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294310    2573 flags.go:64] FLAG: --v="2"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294314    2573 flags.go:64] FLAG: --version="false"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294318    2573 flags.go:64] FLAG: --vmodule=""
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294321    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.294324    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296342    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.509619 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296358    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296362    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296366    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296369    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296372    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296375    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296378    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296381    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296384    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296387    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296389    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296393    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296397    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296399    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296403    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296406    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296408    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296411    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296414    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296416    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.510372 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296419    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296424    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296427    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296430    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296432    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296437    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296441    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296445    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296448    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296451    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296459    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296462    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296465    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296468    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296471    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296474    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296476    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296479    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296482    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.511285 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296484    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296487    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296489    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296492    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296494    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296499    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296501    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296504    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296521    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296524    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296528    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296530    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296533    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296536    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296540    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296542    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296545    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296547    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296550    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.511897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296553    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296555    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296558    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296560    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296564    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296566    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296569    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296573    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296576    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296579    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296582    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296585    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296588    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296590    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296593    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296597    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296600    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296603    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296607    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.512539 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296610    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296612    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296614    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296619    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296621    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296625    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296628    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296630    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296634    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296637    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296639    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296642    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296645    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296648    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296650    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296652    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296655    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296658    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296660    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296663    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.513112 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.296665    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.297210    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.303903    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.303920    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.303941    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.303947    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304001    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304006    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304009    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304012    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304015    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304018    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304021    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304024    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304027    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.513787 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304029    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304032    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304035    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304038    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304040    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304043    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304046    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304049    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304051    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304054    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304057    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304059    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304062    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304065    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304068    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304071    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304073    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304076    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304078    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.514238 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304081    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304084    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304086    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304089    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304092    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304094    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304097    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304099    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304102    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304104    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304107    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304110    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304113    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304115    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304118    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304120    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304124    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304127    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304130    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304132    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.697061 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304135    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304143    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304148    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304151    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304154    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304156    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304159    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304161    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304164    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304166    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304169    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304171    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304174    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304177    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304180    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304182    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304185    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304187    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304190    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304192    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.698291 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304195    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304197    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304200    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304202    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304205    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304207    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304210    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304213    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304215    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304218    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304220    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304223    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304225    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304229    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304233    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304235    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304238    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304241    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304243    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304246    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.699040 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304249    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304251    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304253    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304256    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304259    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304263    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304267    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304271    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304274    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304277    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304279    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.304284    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304403    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304407    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 12:24:44.699697 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304410    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304413    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304416    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304419    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304421    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304424    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304427    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304429    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304433    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304435    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304439    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304442    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304448    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304451    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304454    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304457    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304459    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304462    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304464    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 12:24:44.700247 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304467    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304469    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304472    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304474    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304477    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304479    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304481    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304484    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304487    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304489    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304491    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304494    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304497    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304499    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304502    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304504    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304520    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304523    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304526    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304528    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 12:24:44.701383 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304531    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304533    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304537    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304540    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304542    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304547    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304550    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304553    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304555    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304559    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304563    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304566    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304568    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304571    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304575    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304578    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304581    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304584    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304586    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 12:24:44.702301 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304589    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304591    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304594    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304596    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304599    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304601    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304604    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304606    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304609    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304611    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304614    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304616    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304619    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304621    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304624    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304627    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304630    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304633    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304638    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304641    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 12:24:44.702977 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304643    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304646    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304649    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304651    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304654    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304656    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304659    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304661    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304663    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304666    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304669    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304671    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304673    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304676    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304678    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304681    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304683    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304686    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 12:24:44.703764 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:44.304688    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.304693    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.304816    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.306808    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.308260    2573 server.go:1019] "Starting client certificate rotation"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.308357    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.308392    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.310478    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.311671    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.320204    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.322986    2573 log.go:25] "Validated CRI v1 image API"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.331003    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 12:24:44.943365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.333088    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f289d55f-e7a4-4db9-b5da-ed90a63df939:/dev/nvme0n1p3 fcb8be63-3755-4fcb-8495-a4e94eb80f87:/dev/nvme0n1p4]
Jul 09 12:24:44.943897 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.333103    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 12:24:44.943897 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.337342    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.338416    2573 manager.go:216] Machine: {Timestamp:2026-07-09 12:24:44.337039669 +0000 UTC m=+0.328170811 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106152 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f898216aea44494a61b656788a16 SystemUUID:ec26f898-216a-ea44-494a-61b656788a16 BootID:14699b2c-65cb-47dd-a15b-b83a671d47a2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3b:d6:22:0b:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3b:d6:22:0b:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:44:71:4c:d6:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.338526    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.338638    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.341374    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.341397    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.342060    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.342070    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.342077    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.342628    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.343705    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346304    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346406    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346434    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346444    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346464    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346473    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346482    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 12:24:44.944276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346832    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.346848    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.349304    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.351000    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.351028    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352446    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352458    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352464    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352470    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352478    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352483    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352491    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352496    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352502    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352524    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352534    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.352540    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.353275    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.353281    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.356118    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.356236    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.356364    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.356652    2573 server.go:1268] "Started kubelet"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.356719    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.356727    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.356850    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.358279    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.361169    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.363859    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.363736    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51881202b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.356624427 +0000 UTC m=+0.347755569,LastTimestamp:2026-07-09 12:24:44.356624427 +0000 UTC m=+0.347755569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366297    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366303    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.366360    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366823    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366830    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366846    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366930    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.366939    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367160    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367173    2573 factory.go:55] Registering systemd factory
Jul 09 12:24:44.944971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367183    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367380    2573 factory.go:153] Registering CRI-O factory
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367409    2573 factory.go:223] Registration of the crio container factory successfully
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367427    2573 factory.go:103] Registering Raw factory
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367442    2573 manager.go:1196] Started watching for new ooms in manager
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.367776    2573 manager.go:349] Starting recovery of all containers
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.371872    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.371917    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.374615    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.377469    2573 manager.go:354] Recovery completed
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.383049    2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.387398    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389142    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389172    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389183    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389666    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389674    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389688    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.389709    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390736    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390765    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390780    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390885    2573 policy_none.go:49] "None policy: Start"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390896    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.390907    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.391591    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51a717a4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.389153356 +0000 UTC m=+0.380284501,LastTimestamp:2026-07-09 12:24:44.389153356 +0000 UTC m=+0.380284501,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.392125    2573 policy_none.go:47] "Start"
Jul 09 12:24:44.946151 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.402114    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51a71d802  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-238.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.389177346 +0000 UTC m=+0.380308487,LastTimestamp:2026-07-09 12:24:44.389177346 +0000 UTC m=+0.380308487,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.404412    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51a71fbfe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-238.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.389186558 +0000 UTC m=+0.380317700,LastTimestamp:2026-07-09 12:24:44.389186558 +0000 UTC m=+0.380317700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.413612    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-238.ec2.internal.18c09ea51a717a4c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51a717a4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.389153356 +0000 UTC m=+0.380284501,LastTimestamp:2026-07-09 12:24:44.39074832 +0000 UTC m=+0.381879466,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.421288    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvdlz"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423205    2573 manager.go:337] "Starting Device Plugin manager"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.423255    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-238.ec2.internal.18c09ea51a71d802\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-238.ec2.internal.18c09ea51a71d802  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-238.ec2.internal,UID:ip-10-0-140-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-238.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-238.ec2.internal,},FirstTimestamp:2026-07-09 12:24:44.389177346 +0000 UTC m=+0.380308487,LastTimestamp:2026-07-09 12:24:44.39077268 +0000 UTC m=+0.381903828,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-238.ec2.internal,}"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.423441    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423455    2573 server.go:87] "Starting device plugin registration server"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423730    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423742    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423832    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423925    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.423936    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.424589    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.424659    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.428303    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvdlz"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.524570    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.525656    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.525692    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.525704    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.525733    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.534790    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.534811    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-238.ec2.internal\": node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.555674    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.559826    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 12:24:44.947054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.559861    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.559880    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.559910    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.562202    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.660954    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.660949    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"]
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.661051    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.662073    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.662105    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.662120    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.663408    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.663532    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.663566    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664143    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664154    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664170    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664179    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664187    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.664193    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.665374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.665398    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.666099    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.666118    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.666132    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeHasSufficientPID"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.669079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.669102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.669119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069146ecd5862847c6bad18c20b767ba-config\") pod \"kube-apiserver-proxy-ip-10-0-140-238.ec2.internal\" (UID: \"069146ecd5862847c6bad18c20b767ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.697961    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-238.ec2.internal\" not found" node="ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.702746    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-238.ec2.internal\" not found" node="ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.761120    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.947859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.948752 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069146ecd5862847c6bad18c20b767ba-config\") pod \"kube-apiserver-proxy-ip-10-0-140-238.ec2.internal\" (UID: \"069146ecd5862847c6bad18c20b767ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.948752 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770120    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069146ecd5862847c6bad18c20b767ba-config\") pod \"kube-apiserver-proxy-ip-10-0-140-238.ec2.internal\" (UID: \"069146ecd5862847c6bad18c20b767ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.948752 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770122    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.948752 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:44.770158    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f0f8ba6c4a1d996d20a95fd8f00ef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal\" (UID: \"b0f0f8ba6c4a1d996d20a95fd8f00ef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:44.948752 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.862060    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:45.132837 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:44.962646    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:45.132837 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.002912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:45.132837 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.005799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:45.132837 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.067340    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.173679    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-238.ec2.internal\" not found"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.186153    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.267896    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.279201    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.280871    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.307876    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.308078    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.308171    2573 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a5f1182d4552047c68b36a22b7e15b3c-dd8c04a765c803e7.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.140.238:44452->44.212.196.205:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.308209    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 12:24:45.351615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.347380    2573 apiserver.go:52] "Watching apiserver"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.366212    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.366388    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.366585    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-pgxd8","openshift-network-operator/iptables-alerter-cnd2j","openshift-ovn-kubernetes/ovnkube-node-whd8c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs","openshift-cluster-node-tuning-operator/tuned-h9cbw","openshift-dns/node-resolver-k2td8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal","openshift-multus/multus-additional-cni-plugins-89l2s","openshift-multus/multus-dv756","openshift-multus/network-metrics-daemon-6s54p","openshift-network-diagnostics/network-check-target-pxv45","kube-system/global-pull-secret-syncer-9gx2x","kube-system/konnectivity-agent-mh4lj","kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal"]
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.368305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.368365    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.369887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.371176    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.372870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.372982    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.373001    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dzhnr\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.373006    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.374060    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.374309    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kt7dn\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.375016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.375055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkskx\" (UniqueName: \"kubernetes.io/projected/aa34bdfb-efde-45f9-a992-66925a3c5e1c-kube-api-access-kkskx\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.375307    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.376181    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.376711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.376891    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.376965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4m7vw\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377167    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377224    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377604    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377621    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377604    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.377989    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.378449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fxwrv\""
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.378457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.544162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.378913    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.379795    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f99st\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.380020    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.380169    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.380624    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381119    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381125    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381176    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p5lks\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381554    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381697    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.381816    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.382767    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.382904    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.383142    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h8zzf\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.383411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.384445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.384584    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.384850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.384958    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.386943    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mzc2g\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.386985    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.387065    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.387179    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.387252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-84kc2\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.387271    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.387618    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.387669    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.429742    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 12:19:45 +0000 UTC" deadline="2027-12-29 06:06:56.930082555 +0000 UTC"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.429769    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12905h42m11.500317514s"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.468336    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-netns\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.545210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgzj\" (UniqueName: \"kubernetes.io/projected/66d57738-0165-4d49-8fb1-7cb8f55f9548-kube-api-access-8hgzj\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a900448-d28b-45b8-bef0-1c5b288e67ce-host-slash\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-bin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-hostroot\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.475987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbbd15d1-a308-486e-93ef-0498c4901846-konnectivity-ca\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-systemd\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4g4\" (UniqueName: \"kubernetes.io/projected/886e89e6-95da-4398-b079-4fe53b6ebe98-kube-api-access-wm4g4\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-multus-certs\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-cnibin\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-registration-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysconfig\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-lib-modules\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-socket-dir-parent\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-kubelet-config\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-dbus\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-config\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.546259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-socket-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-sys-fs\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-modprobe-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-multus\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-etc-kubernetes\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.476628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.477086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwwq\" (UniqueName: \"kubernetes.io/projected/f13b1cc4-1211-4762-bae8-e9818413dcf6-kube-api-access-mbwwq\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.477141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-kubernetes\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.477272    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.477556    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:24:45.977527761 +0000 UTC m=+1.968658910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.477179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-cni-binary-copy\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-system-cni-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4zf\" (UniqueName: \"kubernetes.io/projected/eb788023-e540-4a1c-8a0a-f6813750d2b2-kube-api-access-lf4zf\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-script-lib\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-system-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.546899 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-daemon-config\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-binary-copy\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-kubelet\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-slash\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-device-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-host\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-tuned\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.478989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb788023-e540-4a1c-8a0a-f6813750d2b2-hosts-file\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb788023-e540-4a1c-8a0a-f6813750d2b2-tmp-dir\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3875233-eb34-488c-995f-cd86e207b680-serviceca\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-systemd-units\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-etc-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-node-log\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovn-node-metrics-cert\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-sys\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.547501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-netns\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-netd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-env-overrides\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9z2v\" (UniqueName: \"kubernetes.io/projected/9b7ebc4b-5725-4dd5-9f46-0132af15a284-kube-api-access-f9z2v\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-cnibin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-kubelet\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.479986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-log-socket\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-conf-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmkpg\" (UniqueName: \"kubernetes.io/projected/788391b1-c5a2-4672-a359-ee4d971ccdf6-kube-api-access-cmkpg\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480267    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4p6\" (UniqueName: \"kubernetes.io/projected/1a900448-d28b-45b8-bef0-1c5b288e67ce-kube-api-access-vv4p6\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-var-lib-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548091 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-run\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-var-lib-kubelet\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-os-release\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480643    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-bin\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.480666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-tmp\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-os-release\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a900448-d28b-45b8-bef0-1c5b288e67ce-iptables-alerter-script\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkskx\" (UniqueName: \"kubernetes.io/projected/aa34bdfb-efde-45f9-a992-66925a3c5e1c-kube-api-access-kkskx\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3875233-eb34-488c-995f-cd86e207b680-host\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jb8q\" (UniqueName: \"kubernetes.io/projected/c3875233-eb34-488c-995f-cd86e207b680-kube-api-access-9jb8q\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbbd15d1-a308-486e-93ef-0498c4901846-agent-certs\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-systemd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481329    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-conf\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-k8s-cni-cncf-io\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.548870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-ovn\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.481465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.488150    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.491650    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkskx\" (UniqueName: \"kubernetes.io/projected/aa34bdfb-efde-45f9-a992-66925a3c5e1c-kube-api-access-kkskx\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.496251    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p5rzr"
Jul 09 12:24:45.549455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.512809    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p5rzr"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.570193    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovn-node-metrics-cert\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-sys\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-netns\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-netd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-env-overrides\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582769    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-netns\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9z2v\" (UniqueName: \"kubernetes.io/projected/9b7ebc4b-5725-4dd5-9f46-0132af15a284-kube-api-access-f9z2v\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582805    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-netd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-sys\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-cnibin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-kubelet\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582921    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-cnibin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-log-socket\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.746160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582963    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-log-socket\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-conf-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.582990    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-kubelet\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583034    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-conf-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmkpg\" (UniqueName: \"kubernetes.io/projected/788391b1-c5a2-4672-a359-ee4d971ccdf6-kube-api-access-cmkpg\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583076    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583081    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4p6\" (UniqueName: \"kubernetes.io/projected/1a900448-d28b-45b8-bef0-1c5b288e67ce-kube-api-access-vv4p6\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-var-lib-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-run\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-var-lib-kubelet\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-os-release\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583380    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-run\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-env-overrides\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583353    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-var-lib-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-bin\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583409    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-os-release\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583402    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-var-lib-kubelet\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583440    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-cni-bin\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-tmp\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583457    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-os-release\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a900448-d28b-45b8-bef0-1c5b288e67ce-iptables-alerter-script\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3875233-eb34-488c-995f-cd86e207b680-host\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-os-release\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583598    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3875233-eb34-488c-995f-cd86e207b680-host\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583626    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jb8q\" (UniqueName: \"kubernetes.io/projected/c3875233-eb34-488c-995f-cd86e207b680-kube-api-access-9jb8q\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbbd15d1-a308-486e-93ef-0498c4901846-agent-certs\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-systemd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.748708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583730    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-systemd\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-conf\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-k8s-cni-cncf-io\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583867    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysctl-conf\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583869    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-k8s-cni-cncf-io\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-ovn\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-run-ovn\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.583985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-netns\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgzj\" (UniqueName: \"kubernetes.io/projected/66d57738-0165-4d49-8fb1-7cb8f55f9548-kube-api-access-8hgzj\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a900448-d28b-45b8-bef0-1c5b288e67ce-host-slash\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-bin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-run-netns\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-hostroot\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.749380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbbd15d1-a308-486e-93ef-0498c4901846-konnectivity-ca\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.584130    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584153    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a900448-d28b-45b8-bef0-1c5b288e67ce-iptables-alerter-script\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a900448-d28b-45b8-bef0-1c5b288e67ce-host-slash\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584175    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584196    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-hostroot\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.584210    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:46.084190491 +0000 UTC m=+2.075321631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584265    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-bin\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-systemd\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4g4\" (UniqueName: \"kubernetes.io/projected/886e89e6-95da-4398-b079-4fe53b6ebe98-kube-api-access-wm4g4\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-multus-certs\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-cnibin\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584408    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-systemd\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-registration-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysconfig\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-run-multus-certs\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-lib-modules\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.750095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584538    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-registration-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584544    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-cnibin\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-socket-dir-parent\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584604    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-sysconfig\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584610    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-socket-dir-parent\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-kubelet-config\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584654    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-kubelet-config\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-dbus\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584680    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-lib-modules\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-config\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-socket-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-sys-fs\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584759    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8124b40-5d3d-4991-af45-c26d424c1b56-dbus\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-modprobe-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-multus\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584842    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-modprobe-d\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-etc-kubernetes\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.752190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-socket-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584872    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbbd15d1-a308-486e-93ef-0498c4901846-konnectivity-ca\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584877    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-etc-kubernetes\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-sys-fs\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-host-var-lib-cni-multus\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.584992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwwq\" (UniqueName: \"kubernetes.io/projected/f13b1cc4-1211-4762-bae8-e9818413dcf6-kube-api-access-mbwwq\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-kubernetes\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585024    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-cni-binary-copy\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-system-cni-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585086    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-kubernetes\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585125    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-config\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4zf\" (UniqueName: \"kubernetes.io/projected/eb788023-e540-4a1c-8a0a-f6813750d2b2-kube-api-access-lf4zf\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585129    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/788391b1-c5a2-4672-a359-ee4d971ccdf6-system-cni-dir\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-script-lib\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-system-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753129 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-daemon-config\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66d57738-0165-4d49-8fb1-7cb8f55f9548-system-cni-dir\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-binary-copy\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-kubelet\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585480    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-kubelet\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-slash\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585567    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-host-slash\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-device-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-host\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585645    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/886e89e6-95da-4398-b079-4fe53b6ebe98-host\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-tuned\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585675    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f13b1cc4-1211-4762-bae8-e9818413dcf6-device-dir\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb788023-e540-4a1c-8a0a-f6813750d2b2-hosts-file\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585765    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovnkube-script-lib\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb788023-e540-4a1c-8a0a-f6813750d2b2-tmp-dir\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3875233-eb34-488c-995f-cd86e207b680-serviceca\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-systemd-units\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.753816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585843    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb788023-e540-4a1c-8a0a-f6813750d2b2-hosts-file\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-etc-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-node-log\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.585963    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-node-log\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586047    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-cni-binary-copy\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586093    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-systemd-units\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b7ebc4b-5725-4dd5-9f46-0132af15a284-ovn-node-metrics-cert\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586143    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9b7ebc4b-5725-4dd5-9f46-0132af15a284-etc-openvswitch\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586192    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb788023-e540-4a1c-8a0a-f6813750d2b2-tmp-dir\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586197    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-tmp\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586324    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/788391b1-c5a2-4672-a359-ee4d971ccdf6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586468    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3875233-eb34-488c-995f-cd86e207b680-serviceca\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.586476    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbbd15d1-a308-486e-93ef-0498c4901846-agent-certs\") pod \"konnectivity-agent-mh4lj\" (UID: \"bbbd15d1-a308-486e-93ef-0498c4901846\") " pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.588248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/886e89e6-95da-4398-b079-4fe53b6ebe98-etc-tuned\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.592990    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-multus-daemon-config\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.592993    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66d57738-0165-4d49-8fb1-7cb8f55f9548-cni-binary-copy\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.596646    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4p6\" (UniqueName: \"kubernetes.io/projected/1a900448-d28b-45b8-bef0-1c5b288e67ce-kube-api-access-vv4p6\") pod \"iptables-alerter-cnd2j\" (UID: \"1a900448-d28b-45b8-bef0-1c5b288e67ce\") " pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.596651    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.596700    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:24:45.754526 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.596716    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.596783    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:46.096761453 +0000 UTC m=+2.087892585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599381    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4zf\" (UniqueName: \"kubernetes.io/projected/eb788023-e540-4a1c-8a0a-f6813750d2b2-kube-api-access-lf4zf\") pod \"node-resolver-k2td8\" (UID: \"eb788023-e540-4a1c-8a0a-f6813750d2b2\") " pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599426    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwwq\" (UniqueName: \"kubernetes.io/projected/f13b1cc4-1211-4762-bae8-e9818413dcf6-kube-api-access-mbwwq\") pod \"aws-ebs-csi-driver-node-phmhs\" (UID: \"f13b1cc4-1211-4762-bae8-e9818413dcf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599819    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgzj\" (UniqueName: \"kubernetes.io/projected/66d57738-0165-4d49-8fb1-7cb8f55f9548-kube-api-access-8hgzj\") pod \"multus-dv756\" (UID: \"66d57738-0165-4d49-8fb1-7cb8f55f9548\") " pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599839    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmkpg\" (UniqueName: \"kubernetes.io/projected/788391b1-c5a2-4672-a359-ee4d971ccdf6-kube-api-access-cmkpg\") pod \"multus-additional-cni-plugins-89l2s\" (UID: \"788391b1-c5a2-4672-a359-ee4d971ccdf6\") " pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599835    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jb8q\" (UniqueName: \"kubernetes.io/projected/c3875233-eb34-488c-995f-cd86e207b680-kube-api-access-9jb8q\") pod \"node-ca-pgxd8\" (UID: \"c3875233-eb34-488c-995f-cd86e207b680\") " pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.600016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4g4\" (UniqueName: \"kubernetes.io/projected/886e89e6-95da-4398-b079-4fe53b6ebe98-kube-api-access-wm4g4\") pod \"tuned-h9cbw\" (UID: \"886e89e6-95da-4398-b079-4fe53b6ebe98\") " pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.599997    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9z2v\" (UniqueName: \"kubernetes.io/projected/9b7ebc4b-5725-4dd5-9f46-0132af15a284-kube-api-access-f9z2v\") pod \"ovnkube-node-whd8c\" (UID: \"9b7ebc4b-5725-4dd5-9f46-0132af15a284\") " pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.692286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.713450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dv756"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.729089    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:24:45.756555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.739680    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.764561    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h9cbw"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.785341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2td8"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.789447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89l2s"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.804095    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f0f8ba6c4a1d996d20a95fd8f00ef2.slice/crio-bb598baff4bcae2e5a4848d5c8cb9773d09eb710ff421e3335019fff806f6cbc WatchSource:0}: Error finding container bb598baff4bcae2e5a4848d5c8cb9773d09eb710ff421e3335019fff806f6cbc: Status 404 returned error can't find the container with id bb598baff4bcae2e5a4848d5c8cb9773d09eb710ff421e3335019fff806f6cbc
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.804583    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788391b1_c5a2_4672_a359_ee4d971ccdf6.slice/crio-22ec255e25b30831ccc525103cb57b9d7a2039554959120a1c5d862ff559c5d4 WatchSource:0}: Error finding container 22ec255e25b30831ccc525103cb57b9d7a2039554959120a1c5d862ff559c5d4: Status 404 returned error can't find the container with id 22ec255e25b30831ccc525103cb57b9d7a2039554959120a1c5d862ff559c5d4
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.805781    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069146ecd5862847c6bad18c20b767ba.slice/crio-001a902fc9f4ea3b5ad53b3d1473b84c46bb209414b6624014ccdb8b9c63392d WatchSource:0}: Error finding container 001a902fc9f4ea3b5ad53b3d1473b84c46bb209414b6624014ccdb8b9c63392d: Status 404 returned error can't find the container with id 001a902fc9f4ea3b5ad53b3d1473b84c46bb209414b6624014ccdb8b9c63392d
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.806296    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb788023_e540_4a1c_8a0a_f6813750d2b2.slice/crio-4aaf86943dcea8b057e32afcaf6871200399023240b43ebe1605e6ce59d7b6f9 WatchSource:0}: Error finding container 4aaf86943dcea8b057e32afcaf6871200399023240b43ebe1605e6ce59d7b6f9: Status 404 returned error can't find the container with id 4aaf86943dcea8b057e32afcaf6871200399023240b43ebe1605e6ce59d7b6f9
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.810219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnd2j"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.811185    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.814611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pgxd8"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.818339    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.824089    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a900448_d28b_45b8_bef0_1c5b288e67ce.slice/crio-d6c9cbc2b1de33ef03d6ff5c66ac681ed0ce9c1df7b09fc1ac9fe5359b4de956 WatchSource:0}: Error finding container d6c9cbc2b1de33ef03d6ff5c66ac681ed0ce9c1df7b09fc1ac9fe5359b4de956: Status 404 returned error can't find the container with id d6c9cbc2b1de33ef03d6ff5c66ac681ed0ce9c1df7b09fc1ac9fe5359b4de956
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.826009    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3875233_eb34_488c_995f_cd86e207b680.slice/crio-2f5148970eb15e51b9e22829003e147e0f41044738cd34192803e1ca34245af2 WatchSource:0}: Error finding container 2f5148970eb15e51b9e22829003e147e0f41044738cd34192803e1ca34245af2: Status 404 returned error can't find the container with id 2f5148970eb15e51b9e22829003e147e0f41044738cd34192803e1ca34245af2
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:45.989372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.989508    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:45.989592    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:24:46.989553664 +0000 UTC m=+2.980684811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:46.006235 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:45.994381    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbd15d1_a308_486e_93ef_0498c4901846.slice/crio-3fd3d216ee85c5461d7aec9ad80aa18a69592ff5bfca7c944e7923a3e9281a5a WatchSource:0}: Error finding container 3fd3d216ee85c5461d7aec9ad80aa18a69592ff5bfca7c944e7923a3e9281a5a: Status 404 returned error can't find the container with id 3fd3d216ee85c5461d7aec9ad80aa18a69592ff5bfca7c944e7923a3e9281a5a
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:46.087110    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7ebc4b_5725_4dd5_9f46_0132af15a284.slice/crio-c37d02546e99bc0ca5100353e0e3cc4a0eb0cb7d40bebfca70137608009d5d68 WatchSource:0}: Error finding container c37d02546e99bc0ca5100353e0e3cc4a0eb0cb7d40bebfca70137608009d5d68: Status 404 returned error can't find the container with id c37d02546e99bc0ca5100353e0e3cc4a0eb0cb7d40bebfca70137608009d5d68
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.090618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.090717    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.090761    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:47.090748404 +0000 UTC m=+3.081879534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:46.132508    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13b1cc4_1211_4762_bae8_e9818413dcf6.slice/crio-0e66e3637ff204b01f11896dac940572e585e27e248c3e637e1545469f6e138d WatchSource:0}: Error finding container 0e66e3637ff204b01f11896dac940572e585e27e248c3e637e1545469f6e138d: Status 404 returned error can't find the container with id 0e66e3637ff204b01f11896dac940572e585e27e248c3e637e1545469f6e138d
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:24:46.169019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d57738_0165_4d49_8fb1_7cb8f55f9548.slice/crio-88fee060ff109ddb796b5584d9bc7f7bc87b00da1d0f402d0d683ef931876e3e WatchSource:0}: Error finding container 88fee060ff109ddb796b5584d9bc7f7bc87b00da1d0f402d0d683ef931876e3e: Status 404 returned error can't find the container with id 88fee060ff109ddb796b5584d9bc7f7bc87b00da1d0f402d0d683ef931876e3e
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.191139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.191302    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.191325    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.191335    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:46.242288 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.191385    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:47.19137144 +0000 UTC m=+3.182502571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:46.419232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.321263    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.534451    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 12:19:46 +0000 UTC" deadline="2028-02-29 04:02:06.717998164 +0000 UTC"
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.534488    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14391h37m20.183514827s"
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.563053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.563177    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.581312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnd2j" event={"ID":"1a900448-d28b-45b8-bef0-1c5b288e67ce","Type":"ContainerStarted","Data":"d6c9cbc2b1de33ef03d6ff5c66ac681ed0ce9c1df7b09fc1ac9fe5359b4de956"}
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.583684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerStarted","Data":"22ec255e25b30831ccc525103cb57b9d7a2039554959120a1c5d862ff559c5d4"}
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.585185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal" event={"ID":"069146ecd5862847c6bad18c20b767ba","Type":"ContainerStarted","Data":"001a902fc9f4ea3b5ad53b3d1473b84c46bb209414b6624014ccdb8b9c63392d"}
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.587843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal" event={"ID":"b0f0f8ba6c4a1d996d20a95fd8f00ef2","Type":"ContainerStarted","Data":"bb598baff4bcae2e5a4848d5c8cb9773d09eb710ff421e3335019fff806f6cbc"}
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.593933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"c37d02546e99bc0ca5100353e0e3cc4a0eb0cb7d40bebfca70137608009d5d68"}
Jul 09 12:24:46.601508 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.596047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mh4lj" event={"ID":"bbbd15d1-a308-486e-93ef-0498c4901846","Type":"ContainerStarted","Data":"3fd3d216ee85c5461d7aec9ad80aa18a69592ff5bfca7c944e7923a3e9281a5a"}
Jul 09 12:24:46.603624 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.602211    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2td8" event={"ID":"eb788023-e540-4a1c-8a0a-f6813750d2b2","Type":"ContainerStarted","Data":"4aaf86943dcea8b057e32afcaf6871200399023240b43ebe1605e6ce59d7b6f9"}
Jul 09 12:24:46.605774 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.605743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h9cbw" event={"ID":"886e89e6-95da-4398-b079-4fe53b6ebe98","Type":"ContainerStarted","Data":"a7a71852fb16b547ae184037e6d66a0fbb157fa325a4f7061f3dbc266bba2c18"}
Jul 09 12:24:46.616381 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.616311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dv756" event={"ID":"66d57738-0165-4d49-8fb1-7cb8f55f9548","Type":"ContainerStarted","Data":"88fee060ff109ddb796b5584d9bc7f7bc87b00da1d0f402d0d683ef931876e3e"}
Jul 09 12:24:46.618879 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.618847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs" event={"ID":"f13b1cc4-1211-4762-bae8-e9818413dcf6","Type":"ContainerStarted","Data":"0e66e3637ff204b01f11896dac940572e585e27e248c3e637e1545469f6e138d"}
Jul 09 12:24:46.624833 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.624646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pgxd8" event={"ID":"c3875233-eb34-488c-995f-cd86e207b680","Type":"ContainerStarted","Data":"2f5148970eb15e51b9e22829003e147e0f41044738cd34192803e1ca34245af2"}
Jul 09 12:24:46.998040 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:46.997999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:46.998227 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.998187    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:46.998313 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:46.998261    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:24:48.998242724 +0000 UTC m=+4.989373869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:47.099015 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.098973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:47.099204 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.099190    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:47.099266 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.099259    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:49.099239719 +0000 UTC m=+5.090370862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:47.200043 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.199999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:47.200248 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.200194    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:24:47.200248 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.200218    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:24:47.200248 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.200232    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:47.200427 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.200307    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:49.200285724 +0000 UTC m=+5.191416875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:47.535713 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.535640    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 12:19:46 +0000 UTC" deadline="2028-04-25 22:31:23.630656478 +0000 UTC"
Jul 09 12:24:47.535713 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.535710    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15754h6m36.094951033s"
Jul 09 12:24:47.561095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.561061    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:47.561095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.561096    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:47.561339 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.561224    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:47.561339 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:47.561285    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:47.623900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:47.623867    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 12:24:48.564197 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:48.563669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:48.564197 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:48.563816    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:49.019150 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:49.019116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:49.019355 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.019292    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:49.019425 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.019372    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:24:53.019349637 +0000 UTC m=+9.010480774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:49.119763 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:49.119731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:49.119936 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.119898    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:49.120023 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.119978    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:53.119954448 +0000 UTC m=+9.111085583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:49.221072 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:49.220326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:49.221072 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.220604    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:24:49.221072 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.220628    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:24:49.221072 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.220642    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:49.221072 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.220705    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:24:53.220684415 +0000 UTC m=+9.211815548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:49.560849 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:49.560806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:49.561057 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.560989    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:49.561227 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:49.561202    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:49.561365 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:49.561331    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:50.560748 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:50.560485    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:50.560748 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:50.560641    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:51.560460 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:51.560427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:51.560669 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:51.560593    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:51.561094 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:51.560953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:51.561094 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:51.561055    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:52.560428 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:52.560390    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:52.560651 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:52.560551    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:53.060398 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:53.060310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:53.060903 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.060504    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:53.060903 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.060597    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:25:01.060575262 +0000 UTC m=+17.051706399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:24:53.161214 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:53.161169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:53.161396 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.161349    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:53.161461 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.161411    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:01.161391192 +0000 UTC m=+17.152522342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:24:53.263003 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:53.262306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:53.263003 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.262538    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:24:53.263003 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.262579    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:24:53.263003 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.262593    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:53.263003 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.262654    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:01.262639207 +0000 UTC m=+17.253770342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:24:53.560607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:53.560572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:53.560803 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.560709    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:53.560803 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:53.560767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:53.560915 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:53.560884    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:54.561539 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:54.561500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:54.562076 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:54.561640    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:55.560829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:55.560793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:55.560829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:55.560823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:55.561067 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:55.560942    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:55.561067 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:55.561036    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:56.560678 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:56.560459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:56.560678 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:56.560617    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:57.560657 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:57.560459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:57.560821 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:57.560475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:57.560821 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:57.560737    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:24:57.561145 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:57.560831    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:58.561118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:58.561090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:24:58.561505 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:58.561221    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:24:59.560816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:59.560790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:24:59.561004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:24:59.560799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:24:59.561004 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:59.560886    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:24:59.561004 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:24:59.560990    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:00.560356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:00.560322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:00.560809 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:00.560450    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:01.126028 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:01.125992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:01.126186 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.126131    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:01.126249 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.126207    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:25:17.12618893 +0000 UTC m=+33.117320059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:01.226846 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:01.226805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:01.227037 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.226941    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:01.227037 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.227019    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:17.22699852 +0000 UTC m=+33.218129671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:01.327968 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:01.327932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:01.328137 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.328072    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:25:01.328137 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.328091    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:25:01.328137 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.328101    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:01.328265 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.328151    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:17.328138372 +0000 UTC m=+33.319269500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:01.560070 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:01.560042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:01.560262 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.560171    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:01.560262 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:01.560223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:01.560369 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:01.560305    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:02.560872 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:02.560834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:02.561298 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:02.560974    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:03.560857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:03.560820    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:03.561026 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:03.560870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:03.561026 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:03.560971    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:03.561366 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:03.561088    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:04.561125 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:04.561090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:04.561612 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:04.561210    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:05.560354 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:05.560317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:05.560354 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:05.560339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:05.560617 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:05.560427    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:05.560617 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:05.560576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:06.560354 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:06.560326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:06.560737 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:06.560450    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:07.561002 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.560969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:07.561765 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.560969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:07.561765 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:07.561088    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:07.561765 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:07.561163    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:07.680429 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.680350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal" event={"ID":"069146ecd5862847c6bad18c20b767ba","Type":"ContainerStarted","Data":"b4c612cead04795738a5f67dc6b898e8dff98f8f70dcf226cc7a22f5da02906a"}
Jul 09 12:25:07.683415 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683396    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:25:07.683760 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683742    2573 generic.go:356] "Generic (PLEG): container finished" podID="9b7ebc4b-5725-4dd5-9f46-0132af15a284" containerID="1b23f8a992b215f9b870bb7671189a474533fb616a21eafdf3b1bd938556908a" exitCode=1
Jul 09 12:25:07.683831 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"452bd61038aeaa41361f48ae27b721c8a57df46f361e2b02a52cb5458c310ee4"}
Jul 09 12:25:07.683893 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"44f9229bdf7f69e6cfc080870a3e524759f7a863137847cf31167b61664e9d2e"}
Jul 09 12:25:07.683945 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"66780baa6213fb2fadb27e043438e885dc266aeb696f2776d8bf2536928c7111"}
Jul 09 12:25:07.683981 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"65e095b96b0f91a74ffa27adbd1d7dbf649e0f23fdfcbf8c12f169222e7d76b4"}
Jul 09 12:25:07.684025 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.683997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerDied","Data":"1b23f8a992b215f9b870bb7671189a474533fb616a21eafdf3b1bd938556908a"}
Jul 09 12:25:07.684063 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.684045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"a592c01bb2607069fe6fa39e918be994859af465da7fe81e1fa86bfd75d10140"}
Jul 09 12:25:07.686056 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.686031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h9cbw" event={"ID":"886e89e6-95da-4398-b079-4fe53b6ebe98","Type":"ContainerStarted","Data":"af174e607756bee525010c576f76640781a5abc8970d4b411710adfa8aebb632"}
Jul 09 12:25:07.687380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.687359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dv756" event={"ID":"66d57738-0165-4d49-8fb1-7cb8f55f9548","Type":"ContainerStarted","Data":"29364be967d23a56fb22e4ad15ed85409f745125223df8b75843db04fd95b6c8"}
Jul 09 12:25:07.752619 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.752574    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-238.ec2.internal" podStartSLOduration=21.7525589 podStartE2EDuration="21.7525589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:07.714331895 +0000 UTC m=+23.705463044" watchObservedRunningTime="2026-07-09 12:25:07.7525589 +0000 UTC m=+23.743690051"
Jul 09 12:25:07.752873 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.752853    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h9cbw" podStartSLOduration=2.409273379 podStartE2EDuration="22.752848051s" totalImagesPullingTime="20.343574672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:07.752520421 +0000 UTC m=+23.743651563" watchObservedRunningTime="2026-07-09 12:25:07.752848051 +0000 UTC m=+23.743979201"
Jul 09 12:25:07.779215 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:07.779179    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dv756" podStartSLOduration=2.004208875 podStartE2EDuration="22.77916678s" totalImagesPullingTime="20.774957905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:07.778802713 +0000 UTC m=+23.769933864" watchObservedRunningTime="2026-07-09 12:25:07.77916678 +0000 UTC m=+23.770297930"
Jul 09 12:25:08.561229 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.561049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:08.561680 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:08.561308    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:08.690692 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.690658    2573 generic.go:356] "Generic (PLEG): container finished" podID="b0f0f8ba6c4a1d996d20a95fd8f00ef2" containerID="7c6c214f85ba47177bb7b79c6aeeaa52c57887bd6c591a595edbbab25a35076e" exitCode=0
Jul 09 12:25:08.690955 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.690748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal" event={"ID":"b0f0f8ba6c4a1d996d20a95fd8f00ef2","Type":"ContainerDied","Data":"7c6c214f85ba47177bb7b79c6aeeaa52c57887bd6c591a595edbbab25a35076e"}
Jul 09 12:25:08.692226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.692201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mh4lj" event={"ID":"bbbd15d1-a308-486e-93ef-0498c4901846","Type":"ContainerStarted","Data":"57fca2958e6d59ed691b54aa19759920a30abba843a596073153e10aa0f8bf7d"}
Jul 09 12:25:08.693708 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.693684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2td8" event={"ID":"eb788023-e540-4a1c-8a0a-f6813750d2b2","Type":"ContainerStarted","Data":"fd8a32f082ca77ee0d658af61ebad7d552b37419d6f2cc3cc8e862d7d8b74b56"}
Jul 09 12:25:08.695045 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.695019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs" event={"ID":"f13b1cc4-1211-4762-bae8-e9818413dcf6","Type":"ContainerStarted","Data":"648ac2fb5a803f7cff35cb7f8462fa6a7263962251b0cdcb4334bb768cd1e9b2"}
Jul 09 12:25:08.696338 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.696315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pgxd8" event={"ID":"c3875233-eb34-488c-995f-cd86e207b680","Type":"ContainerStarted","Data":"61bc2924e85df15191e651848bfc4844bc85b33d5ac505ac8e8d46829d091fd9"}
Jul 09 12:25:08.697648 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.697616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnd2j" event={"ID":"1a900448-d28b-45b8-bef0-1c5b288e67ce","Type":"ContainerStarted","Data":"c5aab0e2aeeb69765db4ca45e138a4bb3b5505fc29639865e760c809fa544949"}
Jul 09 12:25:08.698770 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.698749    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="c6898946be530e03b3f792af9f929e2e123c95e78dff8287ed59c0ad1f8858b6" exitCode=0
Jul 09 12:25:08.698857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.698780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"c6898946be530e03b3f792af9f929e2e123c95e78dff8287ed59c0ad1f8858b6"}
Jul 09 12:25:08.762955 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.762909    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pgxd8" podStartSLOduration=2.8456542479999998 podStartE2EDuration="23.762894024s" totalImagesPullingTime="20.917239776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:08.762787619 +0000 UTC m=+24.753918797" watchObservedRunningTime="2026-07-09 12:25:08.762894024 +0000 UTC m=+24.754025173"
Jul 09 12:25:08.789064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.789015    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mh4lj" podStartSLOduration=3.058275763 podStartE2EDuration="23.788996208s" totalImagesPullingTime="20.730720445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:08.788382392 +0000 UTC m=+24.779513559" watchObservedRunningTime="2026-07-09 12:25:08.788996208 +0000 UTC m=+24.780127359"
Jul 09 12:25:08.830258 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:08.830167    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k2td8" podStartSLOduration=2.894649697 podStartE2EDuration="23.830148309s" totalImagesPullingTime="20.935498612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:08.810650989 +0000 UTC m=+24.801782169" watchObservedRunningTime="2026-07-09 12:25:08.830148309 +0000 UTC m=+24.821279460"
Jul 09 12:25:09.526941 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.526913    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 12:25:09.560348 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.560326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:09.560457 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.560363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:09.560572 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:09.560432    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:09.560642 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:09.560574    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:09.701844 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.701775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs" event={"ID":"f13b1cc4-1211-4762-bae8-e9818413dcf6","Type":"ContainerStarted","Data":"5957320c0cd5baee6b9856d97e2edfb860f82d1b7919c3f54ffea86b635b9a24"}
Jul 09 12:25:09.703330 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.703307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal" event={"ID":"b0f0f8ba6c4a1d996d20a95fd8f00ef2","Type":"ContainerStarted","Data":"ce05c8a51e08e6f1dbb3f1dbcd72c4c68ab6fa26e2f64285d667f085d69f8897"}
Jul 09 12:25:09.706039 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.706022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:25:09.706453 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.706430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"8d13e7004d6f7a34a51efdefc9db57f21d1bee41fab5ff71e43624cd8854fc6c"}
Jul 09 12:25:09.732096 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.732055    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cnd2j" podStartSLOduration=3.812814623 podStartE2EDuration="24.732042442s" totalImagesPullingTime="20.919227819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:08.829782998 +0000 UTC m=+24.820914150" watchObservedRunningTime="2026-07-09 12:25:09.732042442 +0000 UTC m=+25.723173592"
Jul 09 12:25:09.847991 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.847962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:25:09.848655 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.848631    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:25:09.873097 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:09.873042    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-238.ec2.internal" podStartSLOduration=23.873023408 podStartE2EDuration="23.873023408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:09.731946693 +0000 UTC m=+25.723077863" watchObservedRunningTime="2026-07-09 12:25:09.873023408 +0000 UTC m=+25.864154561"
Jul 09 12:25:10.439096 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.438969    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T12:25:09.526931294Z","UUID":"02921b23-7e4a-47a2-ab88-982e31d76b89","Handler":null,"Name":"","Endpoint":""}
Jul 09 12:25:10.440345 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.440330    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 12:25:10.440446 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.440364    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 12:25:10.560838 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.560805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:10.560983 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:10.560916    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:10.709111 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.709041    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:25:10.709474 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:10.709360    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mh4lj"
Jul 09 12:25:11.560356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:11.560284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:11.560519 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:11.560314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:11.560519 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:11.560451    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:11.560643 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:11.560619    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:11.713565 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:11.713500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs" event={"ID":"f13b1cc4-1211-4762-bae8-e9818413dcf6","Type":"ContainerStarted","Data":"39e75d0ae3501397aa017afc64fe771cab1f8f51365ae04194cd68434a47844b"}
Jul 09 12:25:11.736652 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:11.736598    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phmhs" podStartSLOduration=3.073627708 podStartE2EDuration="26.736578341s" totalImagesPullingTime="23.662950633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:11.736402131 +0000 UTC m=+27.727533282" watchObservedRunningTime="2026-07-09 12:25:11.736578341 +0000 UTC m=+27.727709492"
Jul 09 12:25:12.560979 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:12.560805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:12.561128 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:12.561043    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:12.718125 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:12.718099    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:25:12.718694 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:12.718495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"226cdbadfc16f7d33c2ddd7b05c46479d6031067acb3b20af1a29ea8bb355ae6"}
Jul 09 12:25:12.719038 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:12.719023    2573 scope.go:117] "RemoveContainer" containerID="1b23f8a992b215f9b870bb7671189a474533fb616a21eafdf3b1bd938556908a"
Jul 09 12:25:13.560370 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.560338    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:13.560574 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:13.560459    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:13.560574 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.560521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:13.560674 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:13.560624    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:13.725653 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.725628    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:25:13.726074 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.725995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" event={"ID":"9b7ebc4b-5725-4dd5-9f46-0132af15a284","Type":"ContainerStarted","Data":"2a5a68eff97cae0aef95d5abc02d3707727a521e1d48220694b9092513ac25e2"}
Jul 09 12:25:13.726336 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.726315    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:25:13.726455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.726390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:25:13.726455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.726437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:25:13.743663 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.743627    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:25:13.743859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.743839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:25:13.770166 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:13.770128    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" podStartSLOduration=8.072073605 podStartE2EDuration="28.77011526s" totalImagesPullingTime="20.698041655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:13.769721593 +0000 UTC m=+29.760852785" watchObservedRunningTime="2026-07-09 12:25:13.77011526 +0000 UTC m=+29.761246409"
Jul 09 12:25:14.561646 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:14.561617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:14.561785 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:14.561728    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:15.560595 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:15.560563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:15.560936 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:15.560559    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:15.560936 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:15.560682    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:15.560936 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:15.560723    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:15.731547 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:15.731500    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="9666b296351c79612457dad18946b4e49af16517245f12345b7f7cff65b6520f" exitCode=0
Jul 09 12:25:15.731547 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:15.731538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"9666b296351c79612457dad18946b4e49af16517245f12345b7f7cff65b6520f"}
Jul 09 12:25:16.560300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:16.560266    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:16.560443 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:16.560384    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:17.147259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.147225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:17.147669 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.147370    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:17.147669 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.147433    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:25:49.147419569 +0000 UTC m=+65.138550697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:17.248133 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.248107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:17.248219 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.248211    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:17.248270 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.248261    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:49.248247652 +0000 UTC m=+65.239378785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:17.348413 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.348340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:17.348553 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.348468    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:25:17.348553 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.348482    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:25:17.348553 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.348490    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:17.348657 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.348555    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:25:49.348539043 +0000 UTC m=+65.339670171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:17.560239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.560213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:17.560239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.560242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:17.560436 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.560320    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:17.560436 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:17.560422    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:17.737153 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.737119    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="93bc8c038512d1397e86519609e6624187b8784e4bb195dc65c81c6a7557a361" exitCode=0
Jul 09 12:25:17.737283 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:17.737186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"93bc8c038512d1397e86519609e6624187b8784e4bb195dc65c81c6a7557a361"}
Jul 09 12:25:18.560678 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:18.560655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:18.561040 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:18.560753    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:18.741494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:18.741459    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="1fca8fe6d2a6d466a4ed5a88361cf08688e210133d892ab6011a569f545645d2" exitCode=0
Jul 09 12:25:18.741650 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:18.741497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"1fca8fe6d2a6d466a4ed5a88361cf08688e210133d892ab6011a569f545645d2"}
Jul 09 12:25:19.560076 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:19.560047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:19.560217 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:19.560159    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:19.560274 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:19.560221    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:19.560365 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:19.560346    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:20.560738 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:20.560705    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:20.561101 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:20.560850    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:21.560664 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:21.560625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:21.560935 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:21.560633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:21.560935 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:21.560783    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:21.560935 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:21.560834    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:22.561184 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:22.561149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:22.561651 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:22.561282    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:23.560242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:23.560203    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:23.560242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:23.560242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:23.560477 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:23.560337    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:23.560477 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:23.560453    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:24.562210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:24.562174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:24.562594 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:24.562284    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:24.757306 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:24.757277    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="b9d2359d586a02d5e2adbdec3382c91c05fed4d9437d37bf2780ffb588bae29a" exitCode=0
Jul 09 12:25:24.757466 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:24.757319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"b9d2359d586a02d5e2adbdec3382c91c05fed4d9437d37bf2780ffb588bae29a"}
Jul 09 12:25:25.561015 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:25.560985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:25.561172 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:25.560993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:25.561172 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:25.561069    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:25.561172 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:25.561147    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:25.762707 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:25.762672    2573 generic.go:356] "Generic (PLEG): container finished" podID="788391b1-c5a2-4672-a359-ee4d971ccdf6" containerID="a9f640c40cf4a3947397651795d78dbd6913f2f78626772e7165b4d8984858a6" exitCode=0
Jul 09 12:25:25.762707 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:25.762709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerDied","Data":"a9f640c40cf4a3947397651795d78dbd6913f2f78626772e7165b4d8984858a6"}
Jul 09 12:25:26.561212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:26.561048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:26.561372 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:26.561283    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:26.768030 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:26.768000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89l2s" event={"ID":"788391b1-c5a2-4672-a359-ee4d971ccdf6","Type":"ContainerStarted","Data":"e974114b11bcf655d0bf67e5dd497183eff5e991194d2f0e963398f7f28d43a9"}
Jul 09 12:25:26.800009 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:26.799970    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-89l2s" podStartSLOduration=7.531495783 podStartE2EDuration="41.799957435s" totalImagesPullingTime="34.268461652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:25:26.798824082 +0000 UTC m=+42.789955233" watchObservedRunningTime="2026-07-09 12:25:26.799957435 +0000 UTC m=+42.791088585"
Jul 09 12:25:27.560060 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:27.560031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:27.560231 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:27.560121    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:27.560231 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:27.560186    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:27.560354 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:27.560289    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:28.560866 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:28.560843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:28.561328 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:28.560941    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:29.560821 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:29.560785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:29.561001 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:29.560785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:29.561001 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:29.560905    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:29.561001 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:29.560949    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:30.560779 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:30.560752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:30.560929 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:30.560840    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:31.560400 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:31.560347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:31.560792 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:31.560347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:31.560792 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:31.560470    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:31.560792 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:31.560547    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:32.560644 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:32.560614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:32.561008 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:32.560709    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:33.560086 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:33.560056    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:33.560250 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:33.560157    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:33.560250 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:33.560212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:33.560323 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:33.560285    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:34.561854 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:34.561823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:34.562333 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:34.561901    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:35.560627 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:35.560597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:35.560785 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:35.560692    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:35.560785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:35.560744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:35.560852 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:35.560827    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:36.561054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:36.561025    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:36.561416 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:36.561119    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:37.560588 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:37.560552    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:37.560588 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:37.560594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:37.560928 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:37.560681    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:37.560928 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:37.560788    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:38.560275 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:38.560246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:38.560653 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:38.560344    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:39.560636 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:39.560603    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:39.561076 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:39.560730    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:39.561076 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:39.560776    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:39.561076 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:39.560861    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:40.560223 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:40.560189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:40.560403 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:40.560298    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:41.560409 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:41.560377    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:41.560409 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:41.560397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:41.560900 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:41.560492    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:41.560900 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:41.560601    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:42.560579 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:42.560549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:42.560940 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:42.560670    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:43.560031 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:43.560005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:43.560192 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:43.560125    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:43.560192 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:43.560168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:43.560263 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:43.560228    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:44.561350 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:44.561321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:44.561876 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:44.561415    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:45.561130 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:45.561078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:45.561130 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:45.561126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:45.561364 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:45.561205    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:45.561364 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:45.561320    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:45.741529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:45.741474    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c" podUID="9b7ebc4b-5725-4dd5-9f46-0132af15a284" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 09 12:25:46.560647 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:46.560618    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:46.560848 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:46.560758    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:47.560142 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:47.560105    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:47.560142 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:47.560131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:47.560608 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:47.560222    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:47.560608 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:47.560346    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:48.560674 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:48.560644    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:48.561020 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:48.560744    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:49.202599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:49.202559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:49.202764 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.202670    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:49.202764 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.202722    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs podName:aa34bdfb-efde-45f9-a992-66925a3c5e1c nodeName:}" failed. No retries permitted until 2026-07-09 12:26:53.202707691 +0000 UTC m=+129.193838818 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs") pod "network-metrics-daemon-6s54p" (UID: "aa34bdfb-efde-45f9-a992-66925a3c5e1c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 12:25:49.302967 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:49.302918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:49.303101 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.303060    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:49.303138 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.303117    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret podName:e8124b40-5d3d-4991-af45-c26d424c1b56 nodeName:}" failed. No retries permitted until 2026-07-09 12:26:53.3031027 +0000 UTC m=+129.294233828 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret") pod "global-pull-secret-syncer-9gx2x" (UID: "e8124b40-5d3d-4991-af45-c26d424c1b56") : object "kube-system"/"original-pull-secret" not registered
Jul 09 12:25:49.403525 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:49.403482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:49.403682 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.403641    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 12:25:49.403682 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.403655    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 12:25:49.403682 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.403664    2573 projected.go:196] Error preparing data for projected volume kube-api-access-926pg for pod openshift-network-diagnostics/network-check-target-pxv45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:49.403788 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.403711    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg podName:10b2a0c6-db45-42df-9ba7-e4e19b7785b8 nodeName:}" failed. No retries permitted until 2026-07-09 12:26:53.40369855 +0000 UTC m=+129.394829681 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-926pg" (UniqueName: "kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg") pod "network-check-target-pxv45" (UID: "10b2a0c6-db45-42df-9ba7-e4e19b7785b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 12:25:49.560166 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:49.560143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:49.560312 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.560265    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:49.560364 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:49.560320    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:49.560416 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:49.560398    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:50.560172 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.560150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:50.560685 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:50.560247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:50.854662 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.854402    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gx2x"]
Jul 09 12:25:50.854811 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.854677    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:50.854811 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:50.854787    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:50.856393 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.856368    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxv45"]
Jul 09 12:25:50.856538 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.856454    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:50.856608 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:50.856559    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:50.877356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.877329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6s54p"]
Jul 09 12:25:50.877458 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:50.877417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:50.877550 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:50.877532    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:52.561075 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.561036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:52.561075 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.561062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:52.561489 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.561146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:52.561489 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:52.561161    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gx2x" podUID="e8124b40-5d3d-4991-af45-c26d424c1b56"
Jul 09 12:25:52.561489 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:52.561239    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxv45" podUID="10b2a0c6-db45-42df-9ba7-e4e19b7785b8"
Jul 09 12:25:52.561489 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:25:52.561338    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6s54p" podUID="aa34bdfb-efde-45f9-a992-66925a3c5e1c"
Jul 09 12:25:52.823632 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.823607    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:25:52.823791 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.823642    2573 generic.go:356] "Generic (PLEG): container finished" podID="66d57738-0165-4d49-8fb1-7cb8f55f9548" containerID="29364be967d23a56fb22e4ad15ed85409f745125223df8b75843db04fd95b6c8" exitCode=1
Jul 09 12:25:52.823791 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.823684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dv756" event={"ID":"66d57738-0165-4d49-8fb1-7cb8f55f9548","Type":"ContainerDied","Data":"29364be967d23a56fb22e4ad15ed85409f745125223df8b75843db04fd95b6c8"}
Jul 09 12:25:52.824008 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:52.823996    2573 scope.go:117] "RemoveContainer" containerID="29364be967d23a56fb22e4ad15ed85409f745125223df8b75843db04fd95b6c8"
Jul 09 12:25:53.827402 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:53.827376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:25:53.827810 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:53.827448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dv756" event={"ID":"66d57738-0165-4d49-8fb1-7cb8f55f9548","Type":"ContainerStarted","Data":"7ac5d22b0316ad641d58140a40607a5de92c8e741aa8653d0f90b18bdb20a5fc"}
Jul 09 12:25:54.313152 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.313128    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-238.ec2.internal" event="NodeReady"
Jul 09 12:25:54.313276 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.313245    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 12:25:54.402292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.402268    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sg6zn"]
Jul 09 12:25:54.411566 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.411541    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rxmpq"]
Jul 09 12:25:54.411692 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.411605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.415626 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.415604    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 12:25:54.415725 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.415608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x78d8\""
Jul 09 12:25:54.416370 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.416356    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 12:25:54.420716 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.420567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.423400 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.423383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 12:25:54.423475 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.423461    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 12:25:54.423539 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.423476    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 12:25:54.423599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.423563    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qrtvq\""
Jul 09 12:25:54.433940 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.433920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sg6zn"]
Jul 09 12:25:54.449762 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.449744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rxmpq"]
Jul 09 12:25:54.497275 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.497250    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vpx2k"]
Jul 09 12:25:54.510728 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.510708    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.513904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.513883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n9zx\""
Jul 09 12:25:54.513904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.513906    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 12:25:54.513904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.513915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 12:25:54.514170 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.513971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 12:25:54.514170 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.513910    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 12:25:54.518082 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.518062    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vpx2k"]
Jul 09 12:25:54.540870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.540848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ljx\" (UniqueName: \"kubernetes.io/projected/f8386d01-a467-4d43-be40-7799fd8963ae-kube-api-access-h7ljx\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.540971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.540882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8386d01-a467-4d43-be40-7799fd8963ae-tmp-dir\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.540971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.540915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29d99c7-4da1-49da-98f0-6d45d077c2bd-cert\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.540971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.540956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jpc\" (UniqueName: \"kubernetes.io/projected/b29d99c7-4da1-49da-98f0-6d45d077c2bd-kube-api-access-b8jpc\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.541086 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.540978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8386d01-a467-4d43-be40-7799fd8963ae-config-volume\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.541086 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.541010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8386d01-a467-4d43-be40-7799fd8963ae-metrics-tls\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.561338 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.561316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:25:54.561501 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.561485    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:25:54.561656 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.561634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:25:54.564738 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.564716    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 12:25:54.564849 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.564755    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wl5j\""
Jul 09 12:25:54.564849 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.564766    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 12:25:54.564849 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.564815    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x4nrr\""
Jul 09 12:25:54.565046 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.565022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 12:25:54.565202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.565189    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 12:25:54.641848 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.641822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g2lx\" (UniqueName: \"kubernetes.io/projected/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-api-access-7g2lx\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.641956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.641860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jpc\" (UniqueName: \"kubernetes.io/projected/b29d99c7-4da1-49da-98f0-6d45d077c2bd-kube-api-access-b8jpc\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.641956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.641894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8386d01-a467-4d43-be40-7799fd8963ae-config-volume\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.641956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.641942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8386d01-a467-4d43-be40-7799fd8963ae-metrics-tls\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.642054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.641976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08454f94-58ee-4ce2-a561-ad7b501a1919-crio-socket\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.642054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ljx\" (UniqueName: \"kubernetes.io/projected/f8386d01-a467-4d43-be40-7799fd8963ae-kube-api-access-h7ljx\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.642054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08454f94-58ee-4ce2-a561-ad7b501a1919-data-volume\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.642187 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.642187 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8386d01-a467-4d43-be40-7799fd8963ae-tmp-dir\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.642283 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29d99c7-4da1-49da-98f0-6d45d077c2bd-cert\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.642283 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08454f94-58ee-4ce2-a561-ad7b501a1919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.642420 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642405    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8386d01-a467-4d43-be40-7799fd8963ae-tmp-dir\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.642493 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.642472    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8386d01-a467-4d43-be40-7799fd8963ae-config-volume\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.645958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.645930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8386d01-a467-4d43-be40-7799fd8963ae-metrics-tls\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.646058 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.645976    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29d99c7-4da1-49da-98f0-6d45d077c2bd-cert\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.650364 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.650334    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jpc\" (UniqueName: \"kubernetes.io/projected/b29d99c7-4da1-49da-98f0-6d45d077c2bd-kube-api-access-b8jpc\") pod \"ingress-canary-rxmpq\" (UID: \"b29d99c7-4da1-49da-98f0-6d45d077c2bd\") " pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.651706 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.651688    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ljx\" (UniqueName: \"kubernetes.io/projected/f8386d01-a467-4d43-be40-7799fd8963ae-kube-api-access-h7ljx\") pod \"dns-default-sg6zn\" (UID: \"f8386d01-a467-4d43-be40-7799fd8963ae\") " pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.720824 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.720785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:25:54.727829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.727810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rxmpq"
Jul 09 12:25:54.743459 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08454f94-58ee-4ce2-a561-ad7b501a1919-crio-socket\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08454f94-58ee-4ce2-a561-ad7b501a1919-data-volume\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743710 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743578    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08454f94-58ee-4ce2-a561-ad7b501a1919-crio-socket\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743710 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08454f94-58ee-4ce2-a561-ad7b501a1919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743710 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g2lx\" (UniqueName: \"kubernetes.io/projected/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-api-access-7g2lx\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.743863 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.743831    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08454f94-58ee-4ce2-a561-ad7b501a1919-data-volume\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.744393 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.744354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.746464 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.746437    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08454f94-58ee-4ce2-a561-ad7b501a1919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.756715 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.756653    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g2lx\" (UniqueName: \"kubernetes.io/projected/08454f94-58ee-4ce2-a561-ad7b501a1919-kube-api-access-7g2lx\") pod \"insights-runtime-extractor-vpx2k\" (UID: \"08454f94-58ee-4ce2-a561-ad7b501a1919\") " pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.819891 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.819851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vpx2k"
Jul 09 12:25:54.921592 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.921566    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rxmpq"]
Jul 09 12:25:54.925176 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.925152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sg6zn"]
Jul 09 12:25:54.928336 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:25:54.928303    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29d99c7_4da1_49da_98f0_6d45d077c2bd.slice/crio-b7b7010b5e0337aa6d01faa1b72b6bc458a21e587a043364c5d063f857154105 WatchSource:0}: Error finding container b7b7010b5e0337aa6d01faa1b72b6bc458a21e587a043364c5d063f857154105: Status 404 returned error can't find the container with id b7b7010b5e0337aa6d01faa1b72b6bc458a21e587a043364c5d063f857154105
Jul 09 12:25:54.928779 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:25:54.928759    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8386d01_a467_4d43_be40_7799fd8963ae.slice/crio-d5da75fe04d36978e27a16357afbeabd2f552444fdfc1d6e6c0ce9e6bcdd47ce WatchSource:0}: Error finding container d5da75fe04d36978e27a16357afbeabd2f552444fdfc1d6e6c0ce9e6bcdd47ce: Status 404 returned error can't find the container with id d5da75fe04d36978e27a16357afbeabd2f552444fdfc1d6e6c0ce9e6bcdd47ce
Jul 09 12:25:54.994292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:54.994258    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vpx2k"]
Jul 09 12:25:54.997995 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:25:54.997970    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08454f94_58ee_4ce2_a561_ad7b501a1919.slice/crio-5633ddbc6805e102396b149cae1012f544f817d90672b8b14232ff5b3417ed7b WatchSource:0}: Error finding container 5633ddbc6805e102396b149cae1012f544f817d90672b8b14232ff5b3417ed7b: Status 404 returned error can't find the container with id 5633ddbc6805e102396b149cae1012f544f817d90672b8b14232ff5b3417ed7b
Jul 09 12:25:55.837201 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:55.837163    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpx2k" event={"ID":"08454f94-58ee-4ce2-a561-ad7b501a1919","Type":"ContainerStarted","Data":"5633ddbc6805e102396b149cae1012f544f817d90672b8b14232ff5b3417ed7b"}
Jul 09 12:25:55.839202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:55.839172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rxmpq" event={"ID":"b29d99c7-4da1-49da-98f0-6d45d077c2bd","Type":"ContainerStarted","Data":"b7b7010b5e0337aa6d01faa1b72b6bc458a21e587a043364c5d063f857154105"}
Jul 09 12:25:55.841207 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:55.841180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6zn" event={"ID":"f8386d01-a467-4d43-be40-7799fd8963ae","Type":"ContainerStarted","Data":"d5da75fe04d36978e27a16357afbeabd2f552444fdfc1d6e6c0ce9e6bcdd47ce"}
Jul 09 12:25:57.848674 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:57.848622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6zn" event={"ID":"f8386d01-a467-4d43-be40-7799fd8963ae","Type":"ContainerStarted","Data":"54621fea7684365d58eefedeb1f3876074ac1c8a3c419cb697a1dc4338daaeab"}
Jul 09 12:25:59.894714 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.894051    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"]
Jul 09 12:25:59.897770 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.896820    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:25:59.902653 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.902631    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 12:25:59.903405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.903243    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zk6kf\""
Jul 09 12:25:59.903405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.903358    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 12:25:59.905380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.905360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 12:25:59.913429 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.913412    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 12:25:59.916185 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.916166    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 12:25:59.918022 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.918005    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"]
Jul 09 12:25:59.920609 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.920591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:25:59.924244 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.924213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"]
Jul 09 12:25:59.924555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.924534    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 12:25:59.924555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.924548    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 12:25:59.924712 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.924576    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hvrbm\""
Jul 09 12:25:59.924852 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.924832    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 12:25:59.948097 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.948072    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"]
Jul 09 12:25:59.957174 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.957150    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rx88j"]
Jul 09 12:25:59.959323 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.959305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:25:59.963126 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.963106    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h44bc\""
Jul 09 12:25:59.963912 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.963896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 12:25:59.964104 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.964092    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 12:25:59.964654 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:25:59.964638    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 12:26:00.088765 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.088765 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4b78\" (UniqueName: \"kubernetes.io/projected/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-api-access-m4b78\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088804    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088902    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-root\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj59p\" (UniqueName: \"kubernetes.io/projected/39f6252d-a086-4737-a710-9cd7f255453b-kube-api-access-kj59p\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.088981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.089021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-wtmp\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-textfile\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a18b0a1-84ca-4fa6-a522-14264b55d36f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dws\" (UniqueName: \"kubernetes.io/projected/9a18b0a1-84ca-4fa6-a522-14264b55d36f-kube-api-access-s9dws\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-metrics-client-ca\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-sys\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.089410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.089323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-tls\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.190723 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-root\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.190723 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.190885 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190755    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-root\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.190885 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj59p\" (UniqueName: \"kubernetes.io/projected/39f6252d-a086-4737-a710-9cd7f255453b-kube-api-access-kj59p\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.190885 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.190885 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191029 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.190970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191029 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-wtmp\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191125 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191173 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:26:00.191126    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 09 12:26:00.191219 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-textfile\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191219 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:26:00.191186    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls podName:4b530201-8e00-4bb4-bfa6-655ee0c7f1cc nodeName:}" failed. No retries permitted until 2026-07-09 12:26:00.691169652 +0000 UTC m=+76.682300797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-lqpzv" (UID: "4b530201-8e00-4bb4-bfa6-655ee0c7f1cc") : secret "kube-state-metrics-tls" not found
Jul 09 12:26:00.191219 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-wtmp\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a18b0a1-84ca-4fa6-a522-14264b55d36f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.191379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191286    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dws\" (UniqueName: \"kubernetes.io/projected/9a18b0a1-84ca-4fa6-a522-14264b55d36f-kube-api-access-s9dws\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.191379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-metrics-client-ca\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-sys\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191451    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-textfile\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-tls\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4b78\" (UniqueName: \"kubernetes.io/projected/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-api-access-m4b78\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.191754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191661    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f6252d-a086-4737-a710-9cd7f255453b-sys\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.192212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191805    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.192212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.192212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.191972    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a18b0a1-84ca-4fa6-a522-14264b55d36f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.192441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.192418    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f6252d-a086-4737-a710-9cd7f255453b-metrics-client-ca\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.192789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.192764    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.194360 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.194331    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.194444 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.194401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.194484 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.194448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a18b0a1-84ca-4fa6-a522-14264b55d36f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.194558 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.194539    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39f6252d-a086-4737-a710-9cd7f255453b-node-exporter-tls\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.194593 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.194581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.203966 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.203942    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4b78\" (UniqueName: \"kubernetes.io/projected/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-api-access-m4b78\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.204045 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.203969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj59p\" (UniqueName: \"kubernetes.io/projected/39f6252d-a086-4737-a710-9cd7f255453b-kube-api-access-kj59p\") pod \"node-exporter-rx88j\" (UID: \"39f6252d-a086-4737-a710-9cd7f255453b\") " pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.204045 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.203984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dws\" (UniqueName: \"kubernetes.io/projected/9a18b0a1-84ca-4fa6-a522-14264b55d36f-kube-api-access-s9dws\") pod \"openshift-state-metrics-54cf96dfcf-nzmxz\" (UID: \"9a18b0a1-84ca-4fa6-a522-14264b55d36f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.229262 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.229243    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"
Jul 09 12:26:00.269344 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.269315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rx88j"
Jul 09 12:26:00.280308 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:00.280281    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f6252d_a086_4737_a710_9cd7f255453b.slice/crio-77d85650c6dd560d765deaf80433c4c8e555792ecc2205da7e533b3a4241352f WatchSource:0}: Error finding container 77d85650c6dd560d765deaf80433c4c8e555792ecc2205da7e533b3a4241352f: Status 404 returned error can't find the container with id 77d85650c6dd560d765deaf80433c4c8e555792ecc2205da7e533b3a4241352f
Jul 09 12:26:00.360242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.360092    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz"]
Jul 09 12:26:00.362818 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:00.362788    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a18b0a1_84ca_4fa6_a522_14264b55d36f.slice/crio-3baa4440a77dc4acb398fb85cf45cd27a6856292bc03db54384871d66a9efdc8 WatchSource:0}: Error finding container 3baa4440a77dc4acb398fb85cf45cd27a6856292bc03db54384871d66a9efdc8: Status 404 returned error can't find the container with id 3baa4440a77dc4acb398fb85cf45cd27a6856292bc03db54384871d66a9efdc8
Jul 09 12:26:00.695317 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.695285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.697664 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.697634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b530201-8e00-4bb4-bfa6-655ee0c7f1cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lqpzv\" (UID: \"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.785704 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.785591    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:26:00.788344 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.788310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.793656 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.793632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 12:26:00.793967 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.793947    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 12:26:00.794203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.794186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 12:26:00.794338 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.794313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9t8cc\""
Jul 09 12:26:00.795073 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.795054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 12:26:00.795154 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.795078    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 12:26:00.795154 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.795087    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 12:26:00.795286 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.795267    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 12:26:00.795669 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.795645    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796006    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjsv\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796993 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796993 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796993 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.796993 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.796653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.816992 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.816966    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:26:00.845901 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.845877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"
Jul 09 12:26:00.859492 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.859415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpx2k" event={"ID":"08454f94-58ee-4ce2-a561-ad7b501a1919","Type":"ContainerStarted","Data":"010b3847db51a9ecc5afe57ee83c1f19442a6a0aa5558e44e43c6b5bd7ff481f"}
Jul 09 12:26:00.859610 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.859495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpx2k" event={"ID":"08454f94-58ee-4ce2-a561-ad7b501a1919","Type":"ContainerStarted","Data":"1ce43d78565769edcd0696716cc5e4bf53c72b241fcdbe0f45b976f6dd5608e6"}
Jul 09 12:26:00.861151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.861122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rxmpq" event={"ID":"b29d99c7-4da1-49da-98f0-6d45d077c2bd","Type":"ContainerStarted","Data":"f97daf2ccd30c7c0e7032cee85ac3e94cd1e4d2e14c3641da43128ab19235827"}
Jul 09 12:26:00.863331 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.863308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6zn" event={"ID":"f8386d01-a467-4d43-be40-7799fd8963ae","Type":"ContainerStarted","Data":"093577cb0ca5f5275b02d845b89ca03f7e224edeeded1b609d8dfa7095fc1d00"}
Jul 09 12:26:00.863479 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.863361    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:26:00.864760 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.864735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rx88j" event={"ID":"39f6252d-a086-4737-a710-9cd7f255453b","Type":"ContainerStarted","Data":"77d85650c6dd560d765deaf80433c4c8e555792ecc2205da7e533b3a4241352f"}
Jul 09 12:26:00.866815 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.866793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz" event={"ID":"9a18b0a1-84ca-4fa6-a522-14264b55d36f","Type":"ContainerStarted","Data":"1abc1d7c950af8483d0bc94035a198e266656e6bcae98316c378928c605cce67"}
Jul 09 12:26:00.866911 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.866836    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz" event={"ID":"9a18b0a1-84ca-4fa6-a522-14264b55d36f","Type":"ContainerStarted","Data":"969f2c98935f6c933f046c9e1754203ab772d8c9750b56bea83f306ebd65a842"}
Jul 09 12:26:00.866911 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.866855    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz" event={"ID":"9a18b0a1-84ca-4fa6-a522-14264b55d36f","Type":"ContainerStarted","Data":"3baa4440a77dc4acb398fb85cf45cd27a6856292bc03db54384871d66a9efdc8"}
Jul 09 12:26:00.897092 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjsv\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897391 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897654 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897890 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.897967 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.898021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.897993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.898089 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.898068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.898481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.898454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.899597 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:26:00.898634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle podName:215b93f2-26f4-408e-9267-d141489bd5f7 nodeName:}" failed. No retries permitted until 2026-07-09 12:26:01.398615915 +0000 UTC m=+77.389747061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7") : configmap references non-existent config key: ca-bundle.crt
Jul 09 12:26:00.899597 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.898766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.904751 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.903278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.904751 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.903485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.905020 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.904976    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.908379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.907194    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sg6zn" podStartSLOduration=4.929181682 podStartE2EDuration="6.907177978s" totalImagesPullingTime="1.977996296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:00.906627344 +0000 UTC m=+76.897758515" watchObservedRunningTime="2026-07-09 12:26:00.907177978 +0000 UTC m=+76.898309129"
Jul 09 12:26:00.908379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.907795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.908379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.907990    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.908379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.908012    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.909439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.909322    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.909439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.909390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.910157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.910104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.911059 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.910959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.917450 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.917428    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjsv\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:00.934977 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:00.934930    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rxmpq" podStartSLOduration=1.998506095 podStartE2EDuration="6.934913826s" totalImagesPullingTime="4.936407731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:00.933479573 +0000 UTC m=+76.924610750" watchObservedRunningTime="2026-07-09 12:26:00.934913826 +0000 UTC m=+76.926044976"
Jul 09 12:26:01.010241 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.010206    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv"]
Jul 09 12:26:01.180142 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:01.180076    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b530201_8e00_4bb4_bfa6_655ee0c7f1cc.slice/crio-99dac036b671802d2da0099b073a12b33cecd98803924d1c285c4cda667ad017 WatchSource:0}: Error finding container 99dac036b671802d2da0099b073a12b33cecd98803924d1c285c4cda667ad017: Status 404 returned error can't find the container with id 99dac036b671802d2da0099b073a12b33cecd98803924d1c285c4cda667ad017
Jul 09 12:26:01.405849 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.405805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:01.406751 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.406726    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:01.699311 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.699272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:26:01.873715 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.873677    2573 generic.go:356] "Generic (PLEG): container finished" podID="39f6252d-a086-4737-a710-9cd7f255453b" containerID="d380b732d1028d91b3b41cfa4f5b4e8b082d1a2098562ddb5d75245d4119978d" exitCode=0
Jul 09 12:26:01.873864 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.873769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rx88j" event={"ID":"39f6252d-a086-4737-a710-9cd7f255453b","Type":"ContainerDied","Data":"d380b732d1028d91b3b41cfa4f5b4e8b082d1a2098562ddb5d75245d4119978d"}
Jul 09 12:26:01.875563 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:01.875541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv" event={"ID":"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc","Type":"ContainerStarted","Data":"99dac036b671802d2da0099b073a12b33cecd98803924d1c285c4cda667ad017"}
Jul 09 12:26:02.046221 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.046193    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:26:02.048692 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:02.048665    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215b93f2_26f4_408e_9267_d141489bd5f7.slice/crio-e5de2437287dc8b1216118830598dcc95ee94a009eb6e032818d67ec6dfb3254 WatchSource:0}: Error finding container e5de2437287dc8b1216118830598dcc95ee94a009eb6e032818d67ec6dfb3254: Status 404 returned error can't find the container with id e5de2437287dc8b1216118830598dcc95ee94a009eb6e032818d67ec6dfb3254
Jul 09 12:26:02.815731 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.815699    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b956c689-6ptbr"]
Jul 09 12:26:02.819162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.819138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.823205 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.823180    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 12:26:02.823405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.823390    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9sntg\""
Jul 09 12:26:02.823974 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.823952    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 12:26:02.824130 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.824109    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9e2pa8ru1ds9u\""
Jul 09 12:26:02.824228 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.824150    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 12:26:02.824441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.824421    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 12:26:02.824835 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.824812    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 12:26:02.839291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.839270    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b956c689-6ptbr"]
Jul 09 12:26:02.881118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.881071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"e5de2437287dc8b1216118830598dcc95ee94a009eb6e032818d67ec6dfb3254"}
Jul 09 12:26:02.883479 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.883438    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rx88j" event={"ID":"39f6252d-a086-4737-a710-9cd7f255453b","Type":"ContainerStarted","Data":"0c8577db60006d366bb292008e512d7d1c717fd87a171939d78acc47b5d95a14"}
Jul 09 12:26:02.883627 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.883485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rx88j" event={"ID":"39f6252d-a086-4737-a710-9cd7f255453b","Type":"ContainerStarted","Data":"af222ffbe0eb2ee33be9243e45d0755845ab7ceee8269fb37d4c97b650961318"}
Jul 09 12:26:02.885946 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.885892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz" event={"ID":"9a18b0a1-84ca-4fa6-a522-14264b55d36f","Type":"ContainerStarted","Data":"33a0070f362c2a5f5dc99cb4fc2b5bf6e34e15bb0cfc6abdb74ee1edecb584f1"}
Jul 09 12:26:02.915882 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.915829    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rx88j" podStartSLOduration=2.918616664 podStartE2EDuration="3.915816762s" totalImagesPullingTime="926.140633ms" totalInitContainerRuntime="71.059465ms" isStatefulPod=true podCreationTimestamp="2026-07-09 12:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:02.915650271 +0000 UTC m=+78.906781423" watchObservedRunningTime="2026-07-09 12:26:02.915816762 +0000 UTC m=+78.906947911"
Jul 09 12:26:02.918991 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.918967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919121 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919121 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44f9d\" (UniqueName: \"kubernetes.io/projected/29b90e6f-2328-42c9-87c2-c83d90c646fd-kube-api-access-44f9d\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29b90e6f-2328-42c9-87c2-c83d90c646fd-metrics-client-ca\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919341 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-grpc-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919341 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:02.919438 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:02.919407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020580 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44f9d\" (UniqueName: \"kubernetes.io/projected/29b90e6f-2328-42c9-87c2-c83d90c646fd-kube-api-access-44f9d\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29b90e6f-2328-42c9-87c2-c83d90c646fd-metrics-client-ca\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-grpc-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.020757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.021079 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.020771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.021958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.021906    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29b90e6f-2328-42c9-87c2-c83d90c646fd-metrics-client-ca\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.023857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.023828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.023857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.023845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-grpc-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.024033 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.023879    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.024089 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.024058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-tls\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.024186 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.024165    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.024272 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.024251    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29b90e6f-2328-42c9-87c2-c83d90c646fd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.030183 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.030165    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44f9d\" (UniqueName: \"kubernetes.io/projected/29b90e6f-2328-42c9-87c2-c83d90c646fd-kube-api-access-44f9d\") pod \"thanos-querier-86b956c689-6ptbr\" (UID: \"29b90e6f-2328-42c9-87c2-c83d90c646fd\") " pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:03.129446 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:03.129359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:04.295624 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.295563    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-nzmxz" podStartSLOduration=3.9171117239999997 podStartE2EDuration="5.295538638s" totalImagesPullingTime="1.378426914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:02.950857443 +0000 UTC m=+78.941988621" watchObservedRunningTime="2026-07-09 12:26:04.295538638 +0000 UTC m=+80.286669786"
Jul 09 12:26:04.296127 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.296108    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bbffc4658-4869l"]
Jul 09 12:26:04.309818 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.309794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.315016 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.314981    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 12:26:04.315137 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.315112    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-51nqbivr9fg32\""
Jul 09 12:26:04.315575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.315552    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 12:26:04.315575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.315571    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 12:26:04.315763 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.315585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 12:26:04.315763 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.315709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z57vx\""
Jul 09 12:26:04.318543 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.318222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bbffc4658-4869l"]
Jul 09 12:26:04.332419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-client-certs\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332498 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-tls\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332560 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-metrics-server-audit-profiles\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332560 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfkp\" (UniqueName: \"kubernetes.io/projected/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-kube-api-access-jlfkp\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332687 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332643    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-audit-log\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.332687 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.332678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-client-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-metrics-server-audit-profiles\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433269 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433269 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfkp\" (UniqueName: \"kubernetes.io/projected/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-kube-api-access-jlfkp\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433269 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-audit-log\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433418 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-client-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433418 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-client-certs\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433418 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-tls\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.433922 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.433900    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.434050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.434033    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-audit-log\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.434419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.434394    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-metrics-server-audit-profiles\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.436929 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.436645    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-client-ca-bundle\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.436929 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.436702    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-tls\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.437085 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.436992    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-secret-metrics-server-client-certs\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.446348 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.446325    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfkp\" (UniqueName: \"kubernetes.io/projected/cb7631e9-a5bf-4e43-83c8-8ef24474df6d-kube-api-access-jlfkp\") pod \"metrics-server-7bbffc4658-4869l\" (UID: \"cb7631e9-a5bf-4e43-83c8-8ef24474df6d\") " pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.558355 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.558264    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"]
Jul 09 12:26:04.562469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.562424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.566649 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.566402    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4jn8b\""
Jul 09 12:26:04.576237 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.576032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 12:26:04.597978 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.597956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"]
Jul 09 12:26:04.621252 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.621229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:04.635577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.635467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f68c11d-2633-4531-ad81-9f9205ed0b62-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.635577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.635552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f99cx\" (UniqueName: \"kubernetes.io/projected/9f68c11d-2633-4531-ad81-9f9205ed0b62-kube-api-access-f99cx\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.736690 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.736130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f68c11d-2633-4531-ad81-9f9205ed0b62-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.736690 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.736207    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f99cx\" (UniqueName: \"kubernetes.io/projected/9f68c11d-2633-4531-ad81-9f9205ed0b62-kube-api-access-f99cx\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.740156 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.740128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f68c11d-2633-4531-ad81-9f9205ed0b62-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.751264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.751118    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b956c689-6ptbr"]
Jul 09 12:26:04.758097 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:04.758063    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b90e6f_2328_42c9_87c2_c83d90c646fd.slice/crio-85fe9609a911998fd590f17eba4fd589489c64a50d7c9342c3d46bc228f3770b WatchSource:0}: Error finding container 85fe9609a911998fd590f17eba4fd589489c64a50d7c9342c3d46bc228f3770b: Status 404 returned error can't find the container with id 85fe9609a911998fd590f17eba4fd589489c64a50d7c9342c3d46bc228f3770b
Jul 09 12:26:04.765961 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.765905    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f99cx\" (UniqueName: \"kubernetes.io/projected/9f68c11d-2633-4531-ad81-9f9205ed0b62-kube-api-access-f99cx\") pod \"monitoring-plugin-d5dcff7cf-cgb7w\" (UID: \"9f68c11d-2633-4531-ad81-9f9205ed0b62\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.810184 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.810158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bbffc4658-4869l"]
Jul 09 12:26:04.812712 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:04.812675    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7631e9_a5bf_4e43_83c8_8ef24474df6d.slice/crio-2eda87e58ef30ba2c8d6bc771169121d280d98d0565af7c67be68b84354ceab3 WatchSource:0}: Error finding container 2eda87e58ef30ba2c8d6bc771169121d280d98d0565af7c67be68b84354ceab3: Status 404 returned error can't find the container with id 2eda87e58ef30ba2c8d6bc771169121d280d98d0565af7c67be68b84354ceab3
Jul 09 12:26:04.876403 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.876376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:04.894257 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.894226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv" event={"ID":"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc","Type":"ContainerStarted","Data":"9e6d6a9815535c78e432826975feb55d30d5ac1aa7b767232c9e532437a143ec"}
Jul 09 12:26:04.894371 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.894302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv" event={"ID":"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc","Type":"ContainerStarted","Data":"8ecf8bb79126348fcee9911e76f1be87e7557291636c0c70b5a04d7656edb609"}
Jul 09 12:26:04.894371 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.894335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv" event={"ID":"4b530201-8e00-4bb4-bfa6-655ee0c7f1cc","Type":"ContainerStarted","Data":"2ad7925da7d2ab7fb452204b2b5bd2854360015fea31a8a31d691695d87ccb88"}
Jul 09 12:26:04.896585 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.896495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpx2k" event={"ID":"08454f94-58ee-4ce2-a561-ad7b501a1919","Type":"ContainerStarted","Data":"38d739fc75306f7e6d27555952d0c67b49c8408b6f157af6683d51a4ba941e64"}
Jul 09 12:26:04.900549 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.900502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"85fe9609a911998fd590f17eba4fd589489c64a50d7c9342c3d46bc228f3770b"}
Jul 09 12:26:04.903009 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.902974    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a" exitCode=0
Jul 09 12:26:04.903124 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.903061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a"}
Jul 09 12:26:04.903362 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.903339    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:04.905886 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.905842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l" event={"ID":"cb7631e9-a5bf-4e43-83c8-8ef24474df6d","Type":"ContainerStarted","Data":"2eda87e58ef30ba2c8d6bc771169121d280d98d0565af7c67be68b84354ceab3"}
Jul 09 12:26:04.905961 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.905950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.912159 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.912142    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nj5qb\""
Jul 09 12:26:04.912773 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.912754    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 12:26:04.913360 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.913342    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 12:26:04.914064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.914049    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 12:26:04.914435 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.914419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 12:26:04.914583 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.914564    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 12:26:04.914804 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.914789    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 12:26:04.914950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.914934    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 12:26:04.936673 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.936637    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:04.938116 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.937978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.938213 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.938175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.938303 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.938244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.938303 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.938278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr9fb\" (UniqueName: \"kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.938409 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.938346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.939045 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.938585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:04.946271 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:04.946230    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lqpzv" podStartSLOduration=2.64883197 podStartE2EDuration="5.946216564s" totalImagesPullingTime="3.297384594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:04.944868955 +0000 UTC m=+80.936000107" watchObservedRunningTime="2026-07-09 12:26:04.946216564 +0000 UTC m=+80.937347714"
Jul 09 12:26:05.039600 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.039600 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.039797 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.039797 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.039797 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr9fb\" (UniqueName: \"kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.039797 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.039747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.040462 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.040435    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.040462 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.040465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.040695 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.040465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.042107 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.042084    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.042225 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.042207    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.044853 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.044829    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"]
Jul 09 12:26:05.048322 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:05.048301    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f68c11d_2633_4531_ad81_9f9205ed0b62.slice/crio-bae32af0ba2e739490d0181f66264e04ccabd2742af531ea46267cb26a380ef2 WatchSource:0}: Error finding container bae32af0ba2e739490d0181f66264e04ccabd2742af531ea46267cb26a380ef2: Status 404 returned error can't find the container with id bae32af0ba2e739490d0181f66264e04ccabd2742af531ea46267cb26a380ef2
Jul 09 12:26:05.054727 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.054707    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr9fb\" (UniqueName: \"kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb\") pod \"console-76566f8768-dz5f2\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") " pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.098944 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.098901    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vpx2k" podStartSLOduration=1.7628807850000001 podStartE2EDuration="11.098888554s" totalImagesPullingTime="9.336007769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:25:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:05.098617949 +0000 UTC m=+81.089749118" watchObservedRunningTime="2026-07-09 12:26:05.098888554 +0000 UTC m=+81.090019704"
Jul 09 12:26:05.137764 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.137738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67d654b4c8-wb4km"]
Jul 09 12:26:05.140907 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.140886    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.145741 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.145722    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9x2lg\""
Jul 09 12:26:05.146231 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.146204    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 12:26:05.146372 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.146289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 12:26:05.146372 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.146289    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 12:26:05.146822 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.146803    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 12:26:05.146919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.146806    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 12:26:05.153065 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.153046    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 12:26:05.161742 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.161709    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d654b4c8-wb4km"]
Jul 09 12:26:05.216265 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.216233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:05.242130 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-serving-certs-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lfx\" (UniqueName: \"kubernetes.io/projected/3182aba6-b776-4b6f-b482-23c838c15ec6-kube-api-access-r8lfx\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-federate-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.242488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.242369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-metrics-client-ca\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.343618 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-federate-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-metrics-client-ca\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-serving-certs-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lfx\" (UniqueName: \"kubernetes.io/projected/3182aba6-b776-4b6f-b482-23c838c15ec6-kube-api-access-r8lfx\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.343857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.344550 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.344524    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-metrics-client-ca\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.345079 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.345051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.345717 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.345669    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3182aba6-b776-4b6f-b482-23c838c15ec6-serving-certs-ca-bundle\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.346342 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.346280    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.346412 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.346388    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-telemeter-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.346412 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.346401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-federate-client-tls\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.346490 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.346469    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3182aba6-b776-4b6f-b482-23c838c15ec6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.353330 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.353308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lfx\" (UniqueName: \"kubernetes.io/projected/3182aba6-b776-4b6f-b482-23c838c15ec6-kube-api-access-r8lfx\") pod \"telemeter-client-67d654b4c8-wb4km\" (UID: \"3182aba6-b776-4b6f-b482-23c838c15ec6\") " pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.361316 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.361293    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:05.364027 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:05.364005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945af9d5_303c_46c0_862d_b475b480b2ab.slice/crio-d39319fb175d71e16cb685c30886f038e0eda4a6112cbf93f63553680bec1530 WatchSource:0}: Error finding container d39319fb175d71e16cb685c30886f038e0eda4a6112cbf93f63553680bec1530: Status 404 returned error can't find the container with id d39319fb175d71e16cb685c30886f038e0eda4a6112cbf93f63553680bec1530
Jul 09 12:26:05.450171 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.450130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km"
Jul 09 12:26:05.615006 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.614868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d654b4c8-wb4km"]
Jul 09 12:26:05.618636 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:05.618601    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3182aba6_b776_4b6f_b482_23c838c15ec6.slice/crio-ab270124058d5d6d4c2648f04cabe653fe55b8e44c8de8cbb0563f2d460cd63a WatchSource:0}: Error finding container ab270124058d5d6d4c2648f04cabe653fe55b8e44c8de8cbb0563f2d460cd63a: Status 404 returned error can't find the container with id ab270124058d5d6d4c2648f04cabe653fe55b8e44c8de8cbb0563f2d460cd63a
Jul 09 12:26:05.912187 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.912091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76566f8768-dz5f2" event={"ID":"945af9d5-303c-46c0-862d-b475b480b2ab","Type":"ContainerStarted","Data":"d39319fb175d71e16cb685c30886f038e0eda4a6112cbf93f63553680bec1530"}
Jul 09 12:26:05.913668 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.913593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w" event={"ID":"9f68c11d-2633-4531-ad81-9f9205ed0b62","Type":"ContainerStarted","Data":"bae32af0ba2e739490d0181f66264e04ccabd2742af531ea46267cb26a380ef2"}
Jul 09 12:26:05.916298 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:05.915555    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km" event={"ID":"3182aba6-b776-4b6f-b482-23c838c15ec6","Type":"ContainerStarted","Data":"ab270124058d5d6d4c2648f04cabe653fe55b8e44c8de8cbb0563f2d460cd63a"}
Jul 09 12:26:06.113703 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.113140    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:26:06.116638 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.116617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.121240 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.121006    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 12:26:06.121240 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.121227    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 12:26:06.121973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.121553    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 12:26:06.121973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.121827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 12:26:06.123473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.122940    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 12:26:06.123473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123078    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p4hnx\""
Jul 09 12:26:06.123473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123209    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 12:26:06.123473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 12:26:06.123473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123384    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 12:26:06.123784 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123607    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 12:26:06.123784 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 12:26:06.123894 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123871    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a2nr1b7uuoa6k\""
Jul 09 12:26:06.123944 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.123918    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 12:26:06.124503 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.124402    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 12:26:06.125932 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.125820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 12:26:06.138197 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.138180    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 12:26:06.141289 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.140614    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.152976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.153629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2hk\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.154441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.154441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.154441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.154441 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.153394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254055 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254055 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2hk\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.254599 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254592    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.255032 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.255032 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.255032 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.254690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.256965 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.255326    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.256965 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.256107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.259462 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.259436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.261014 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.260988    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.261351 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.261134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.261451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.261383    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.261778 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.261663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.262353 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.262290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.266352 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.266296    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.267343 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.267077    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.267871 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.267797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.268369 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.268227    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.268369 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.268331    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.268846 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.268799    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.269216 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.269157    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.271443 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.271373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.271443 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.271381    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.273669 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.273630    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.274260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.274238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.278572 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.278530    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2hk\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk\") pod \"prometheus-k8s-0\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:06.442040 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:06.441717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:07.878039 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:07.878007    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sg6zn"
Jul 09 12:26:09.887433 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.887224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:26:09.891187 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:09.891151    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bcdbee_7f6b_4980_a45b_a0544da23184.slice/crio-57cac98c2c189c9fe03f9d93b07c88db3ea9ac906de0ef3bb0f89f9156fe8d79 WatchSource:0}: Error finding container 57cac98c2c189c9fe03f9d93b07c88db3ea9ac906de0ef3bb0f89f9156fe8d79: Status 404 returned error can't find the container with id 57cac98c2c189c9fe03f9d93b07c88db3ea9ac906de0ef3bb0f89f9156fe8d79
Jul 09 12:26:09.952024 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.950120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"}
Jul 09 12:26:09.952024 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.950269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"}
Jul 09 12:26:09.955056 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.954562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l" event={"ID":"cb7631e9-a5bf-4e43-83c8-8ef24474df6d","Type":"ContainerStarted","Data":"54f41ad513bd52025c69b580781e07c835f4d599ea6eb88b1a0d8cbce1f08bfd"}
Jul 09 12:26:09.962529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.962480    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76566f8768-dz5f2" event={"ID":"945af9d5-303c-46c0-862d-b475b480b2ab","Type":"ContainerStarted","Data":"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"}
Jul 09 12:26:09.966132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.965027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w" event={"ID":"9f68c11d-2633-4531-ad81-9f9205ed0b62","Type":"ContainerStarted","Data":"872310346c02a742ad9b7ac1ddd4388973c625892f6111575ac1000e8e6cde0c"}
Jul 09 12:26:09.966132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.965802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:09.969596 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.969573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km" event={"ID":"3182aba6-b776-4b6f-b482-23c838c15ec6","Type":"ContainerStarted","Data":"5970550a811e8f92ca079d8438d1cd58df898c6ca14d4692b2db36b3aee1650a"}
Jul 09 12:26:09.969762 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.969745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km" event={"ID":"3182aba6-b776-4b6f-b482-23c838c15ec6","Type":"ContainerStarted","Data":"1db6c35fd5beaf897d9fbd891967a4a4b93d27f8222168f617f325b3da93d270"}
Jul 09 12:26:09.971405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.971384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w"
Jul 09 12:26:09.971703 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.971684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"924b5d897881531ea4182cc015205fe167dfe5eca6f070b61db01e0ab9757499"}
Jul 09 12:26:09.971948 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.971916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"8ba109535ced7c92b9475fad03f396ce346574f0db9f423549c3949f59039ead"}
Jul 09 12:26:09.973052 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.972972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"57cac98c2c189c9fe03f9d93b07c88db3ea9ac906de0ef3bb0f89f9156fe8d79"}
Jul 09 12:26:09.981810 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:09.981753    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l" podStartSLOduration=1.137873146 podStartE2EDuration="5.981735595s" totalImagesPullingTime="4.843862449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:09.978904607 +0000 UTC m=+85.970035760" watchObservedRunningTime="2026-07-09 12:26:09.981735595 +0000 UTC m=+85.972866742"
Jul 09 12:26:10.008763 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.006693    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76566f8768-dz5f2" podStartSLOduration=1.696853519 podStartE2EDuration="6.006673295s" totalImagesPullingTime="4.309819776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:10.004878838 +0000 UTC m=+85.996009988" watchObservedRunningTime="2026-07-09 12:26:10.006673295 +0000 UTC m=+85.997804446"
Jul 09 12:26:10.027079 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.027027    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cgb7w" podStartSLOduration=1.408072504 podStartE2EDuration="6.027006308s" totalImagesPullingTime="4.618933804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:10.02534902 +0000 UTC m=+86.016480186" watchObservedRunningTime="2026-07-09 12:26:10.027006308 +0000 UTC m=+86.018137460"
Jul 09 12:26:10.979043 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.979011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"de8074cad2e1b08f34cf516e05ee54a74cef67bde165f2176b1836aeb57541d4"}
Jul 09 12:26:10.980398 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.980376    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198" exitCode=0
Jul 09 12:26:10.980493 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.980458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"}
Jul 09 12:26:10.983452 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.983433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"}
Jul 09 12:26:10.983571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.983495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"}
Jul 09 12:26:10.983571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.983548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"}
Jul 09 12:26:10.985365 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:10.985344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km" event={"ID":"3182aba6-b776-4b6f-b482-23c838c15ec6","Type":"ContainerStarted","Data":"52ae73ed14b3b55ab94944a486ec45383bd0d8300ec5e75ac8980ecdaf1e6be0"}
Jul 09 12:26:11.119153 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:11.118958    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67d654b4c8-wb4km" podStartSLOduration=2.062925179 podStartE2EDuration="6.118938207s" totalImagesPullingTime="4.056013028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:11.117106474 +0000 UTC m=+87.108237643" watchObservedRunningTime="2026-07-09 12:26:11.118938207 +0000 UTC m=+87.110069360"
Jul 09 12:26:11.996773 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:11.996725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"9126d5347255a802a304c382c16983c9f8b18bd0643e6b4c73e9608a7b5ef01f"}
Jul 09 12:26:11.997224 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:11.996851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"6744cb7fdc4b1aa972943b3029e709c0aadb062e56ea3ef4cc9c8d6174ae0521"}
Jul 09 12:26:11.997224 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:11.996942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:11.997224 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:11.996988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" event={"ID":"29b90e6f-2328-42c9-87c2-c83d90c646fd","Type":"ContainerStarted","Data":"ccb1c12a2c53bf8abe9db535698abdb6e568ed1eb3099c6c0579af46938e1ff0"}
Jul 09 12:26:12.000568 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:12.000523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerStarted","Data":"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"}
Jul 09 12:26:12.037187 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:12.037135    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr" podStartSLOduration=4.123758238 podStartE2EDuration="10.037113049s" totalImagesPullingTime="5.913354811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:12.035481901 +0000 UTC m=+88.026613100" watchObservedRunningTime="2026-07-09 12:26:12.037113049 +0000 UTC m=+88.028244179"
Jul 09 12:26:12.089615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:12.089566    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.932856653 podStartE2EDuration="12.089550539s" totalImagesPullingTime="8.131996016s" totalInitContainerRuntime="24.69787ms" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:12.086788117 +0000 UTC m=+88.077919290" watchObservedRunningTime="2026-07-09 12:26:12.089550539 +0000 UTC m=+88.080681688"
Jul 09 12:26:15.216494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:15.216442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:15.216905 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:15.216622    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:15.221862 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:15.221836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:15.742424 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:15.742400    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whd8c"
Jul 09 12:26:16.020176 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"}
Jul 09 12:26:16.020335 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"}
Jul 09 12:26:16.020335 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"}
Jul 09 12:26:16.020335 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"}
Jul 09 12:26:16.020335 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"}
Jul 09 12:26:16.020458 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.020344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerStarted","Data":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"}
Jul 09 12:26:16.024016 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.023990    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:16.060874 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.060822    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.938406092 podStartE2EDuration="10.060807381s" totalImagesPullingTime="4.09420123s" totalInitContainerRuntime="28.200059ms" isStatefulPod=false podCreationTimestamp="2026-07-09 12:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:16.058472389 +0000 UTC m=+92.049603557" watchObservedRunningTime="2026-07-09 12:26:16.060807381 +0000 UTC m=+92.051938529"
Jul 09 12:26:16.442724 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:16.442643    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:26:18.011361 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:18.011332    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b956c689-6ptbr"
Jul 09 12:26:23.684105 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:23.684071    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:24.621732 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:24.621701    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:24.621890 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:24.621747    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:44.626434 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:44.626402    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:44.630324 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:44.630300    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bbffc4658-4869l"
Jul 09 12:26:48.703994 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:48.703951    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76566f8768-dz5f2" podUID="945af9d5-303c-46c0-862d-b475b480b2ab" containerName="console" containerID="cri-o://7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a" gracePeriod=15
Jul 09 12:26:48.946941 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:48.946921    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:49.053223 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053196    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053371 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053235    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053371 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053266    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053466 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053626 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr9fb\" (UniqueName: \"kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053626 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053548    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert\") pod \"945af9d5-303c-46c0-862d-b475b480b2ab\" (UID: \"945af9d5-303c-46c0-862d-b475b480b2ab\") "
Jul 09 12:26:49.053736 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053628    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config" (OuterVolumeSpecName: "console-config") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:26:49.053834 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053807    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:26:49.053883 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053857    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:26:49.053964 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053950    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-service-ca\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.054013 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053970    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-oauth-serving-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.054013 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.053984    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/945af9d5-303c-46c0-862d-b475b480b2ab-console-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.055449 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.055428    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:26:49.055755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.055730    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:26:49.055755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.055735    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb" (OuterVolumeSpecName: "kube-api-access-fr9fb") pod "945af9d5-303c-46c0-862d-b475b480b2ab" (UID: "945af9d5-303c-46c0-862d-b475b480b2ab"). InnerVolumeSpecName "kube-api-access-fr9fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:26:49.145109 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.145077    2573 generic.go:356] "Generic (PLEG): container finished" podID="945af9d5-303c-46c0-862d-b475b480b2ab" containerID="7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a" exitCode=0
Jul 09 12:26:49.145239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.145136    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76566f8768-dz5f2"
Jul 09 12:26:49.145239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.145158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76566f8768-dz5f2" event={"ID":"945af9d5-303c-46c0-862d-b475b480b2ab","Type":"ContainerDied","Data":"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"}
Jul 09 12:26:49.145239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.145208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76566f8768-dz5f2" event={"ID":"945af9d5-303c-46c0-862d-b475b480b2ab","Type":"ContainerDied","Data":"d39319fb175d71e16cb685c30886f038e0eda4a6112cbf93f63553680bec1530"}
Jul 09 12:26:49.145239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.145236    2573 scope.go:117] "RemoveContainer" containerID="7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"
Jul 09 12:26:49.153617 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.153600    2573 scope.go:117] "RemoveContainer" containerID="7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"
Jul 09 12:26:49.153864 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:26:49.153843    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a\": container with ID starting with 7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a not found: ID does not exist" containerID="7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"
Jul 09 12:26:49.153949 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.153873    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a"} err="failed to get container status \"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a\": rpc error: code = NotFound desc = could not find container \"7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a\": container with ID starting with 7b71c3e731e4abe1741bf1af15eb63aee5d6c7705af799990d9852c818d7d24a not found: ID does not exist"
Jul 09 12:26:49.155300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.155286    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-oauth-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.155347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.155303    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/945af9d5-303c-46c0-862d-b475b480b2ab-console-serving-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.155347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.155314    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr9fb\" (UniqueName: \"kubernetes.io/projected/945af9d5-303c-46c0-862d-b475b480b2ab-kube-api-access-fr9fb\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:26:49.171298 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.171278    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:49.180606 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:49.180584    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76566f8768-dz5f2"]
Jul 09 12:26:50.565481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:50.565444    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="945af9d5-303c-46c0-862d-b475b480b2ab" path="/var/lib/kubelet/pods/945af9d5-303c-46c0-862d-b475b480b2ab/volumes"
Jul 09 12:26:53.293829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.293789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:26:53.297146 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.297126    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 12:26:53.306906 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.306876    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa34bdfb-efde-45f9-a992-66925a3c5e1c-metrics-certs\") pod \"network-metrics-daemon-6s54p\" (UID: \"aa34bdfb-efde-45f9-a992-66925a3c5e1c\") " pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:26:53.379609 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.379580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x4nrr\""
Jul 09 12:26:53.387296 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.387279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6s54p"
Jul 09 12:26:53.395249 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.395225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:26:53.399864 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.399842    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 12:26:53.407851 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.407832    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8124b40-5d3d-4991-af45-c26d424c1b56-original-pull-secret\") pod \"global-pull-secret-syncer-9gx2x\" (UID: \"e8124b40-5d3d-4991-af45-c26d424c1b56\") " pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:26:53.496041 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.496012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:26:53.499111 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.499090    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 12:26:53.509919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.509898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 12:26:53.515860 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.515716    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6s54p"]
Jul 09 12:26:53.518923 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:53.518898    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa34bdfb_efde_45f9_a992_66925a3c5e1c.slice/crio-432dd5ccc145dae71e87f3d761eda3a1df08797fcd0199fc203cc4b7af13eb83 WatchSource:0}: Error finding container 432dd5ccc145dae71e87f3d761eda3a1df08797fcd0199fc203cc4b7af13eb83: Status 404 returned error can't find the container with id 432dd5ccc145dae71e87f3d761eda3a1df08797fcd0199fc203cc4b7af13eb83
Jul 09 12:26:53.520436 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.520416    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-926pg\" (UniqueName: \"kubernetes.io/projected/10b2a0c6-db45-42df-9ba7-e4e19b7785b8-kube-api-access-926pg\") pod \"network-check-target-pxv45\" (UID: \"10b2a0c6-db45-42df-9ba7-e4e19b7785b8\") " pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:26:53.670787 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.670717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gx2x"
Jul 09 12:26:53.684813 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.684790    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wl5j\""
Jul 09 12:26:53.691480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.691455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:26:53.823745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.823713    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gx2x"]
Jul 09 12:26:53.826585 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:53.826555    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8124b40_5d3d_4991_af45_c26d424c1b56.slice/crio-9f9c69924f8085b6471f5fa59f51ada838c686353ee968c9a50ec72ea18855f2 WatchSource:0}: Error finding container 9f9c69924f8085b6471f5fa59f51ada838c686353ee968c9a50ec72ea18855f2: Status 404 returned error can't find the container with id 9f9c69924f8085b6471f5fa59f51ada838c686353ee968c9a50ec72ea18855f2
Jul 09 12:26:53.840438 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:53.840406    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxv45"]
Jul 09 12:26:53.844890 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:26:53.844863    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b2a0c6_db45_42df_9ba7_e4e19b7785b8.slice/crio-7b4f293321eb4005a8430444e71d156993179154a0705797a13606a79d2166b1 WatchSource:0}: Error finding container 7b4f293321eb4005a8430444e71d156993179154a0705797a13606a79d2166b1: Status 404 returned error can't find the container with id 7b4f293321eb4005a8430444e71d156993179154a0705797a13606a79d2166b1
Jul 09 12:26:54.165355 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:54.165320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxv45" event={"ID":"10b2a0c6-db45-42df-9ba7-e4e19b7785b8","Type":"ContainerStarted","Data":"7b4f293321eb4005a8430444e71d156993179154a0705797a13606a79d2166b1"}
Jul 09 12:26:54.166570 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:54.166541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gx2x" event={"ID":"e8124b40-5d3d-4991-af45-c26d424c1b56","Type":"ContainerStarted","Data":"9f9c69924f8085b6471f5fa59f51ada838c686353ee968c9a50ec72ea18855f2"}
Jul 09 12:26:54.167756 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:54.167730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6s54p" event={"ID":"aa34bdfb-efde-45f9-a992-66925a3c5e1c","Type":"ContainerStarted","Data":"432dd5ccc145dae71e87f3d761eda3a1df08797fcd0199fc203cc4b7af13eb83"}
Jul 09 12:26:55.175870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:55.175757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6s54p" event={"ID":"aa34bdfb-efde-45f9-a992-66925a3c5e1c","Type":"ContainerStarted","Data":"b60e30d59607982a900a943fed0aa935bc69ae22f3f0ddb8f7511d3c9d14d43e"}
Jul 09 12:26:55.175870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:55.175864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6s54p" event={"ID":"aa34bdfb-efde-45f9-a992-66925a3c5e1c","Type":"ContainerStarted","Data":"4373e2b9daa4db8cd8a469eace9e0d8e65bb27e1df669ba748730ef34a3023f2"}
Jul 09 12:26:55.198682 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:55.198633    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6s54p" podStartSLOduration=129.266128021 podStartE2EDuration="2m10.198615732s" totalImagesPullingTime="932.487711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:55.198498942 +0000 UTC m=+131.189630093" watchObservedRunningTime="2026-07-09 12:26:55.198615732 +0000 UTC m=+131.189746881"
Jul 09 12:26:59.196162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:59.196128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxv45" event={"ID":"10b2a0c6-db45-42df-9ba7-e4e19b7785b8","Type":"ContainerStarted","Data":"164a42ea2a8bba6e3054479110761a6f2a070ee4a2b03fda3efaf4c0c3849595"}
Jul 09 12:26:59.196586 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:59.196258    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:26:59.197631 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:59.197605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gx2x" event={"ID":"e8124b40-5d3d-4991-af45-c26d424c1b56","Type":"ContainerStarted","Data":"f4670ee1db2ce9d6e054f899cf0a2cbea1d1490b19ca9d22837738f353accb8f"}
Jul 09 12:26:59.254196 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:59.254153    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pxv45" podStartSLOduration=129.144622401 podStartE2EDuration="2m14.254139803s" totalImagesPullingTime="5.109517402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:59.252891047 +0000 UTC m=+135.244022229" watchObservedRunningTime="2026-07-09 12:26:59.254139803 +0000 UTC m=+135.245270953"
Jul 09 12:26:59.276356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:26:59.276299    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9gx2x" podStartSLOduration=129.148344617 podStartE2EDuration="2m14.276281325s" totalImagesPullingTime="5.127936708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 12:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:26:59.275555526 +0000 UTC m=+135.266686677" watchObservedRunningTime="2026-07-09 12:26:59.276281325 +0000 UTC m=+135.267412483"
Jul 09 12:27:06.442380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:06.442344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:06.462037 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:06.462004    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:07.244200 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:07.244176    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:17.891705 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.891673    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:27:17.892154 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.892013    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945af9d5-303c-46c0-862d-b475b480b2ab" containerName="console"
Jul 09 12:27:17.892154 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.892028    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="945af9d5-303c-46c0-862d-b475b480b2ab" containerName="console"
Jul 09 12:27:17.892154 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.892096    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="945af9d5-303c-46c0-862d-b475b480b2ab" containerName="console"
Jul 09 12:27:17.896951 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.896936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.899526 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.899492    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 12:27:17.899657 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.899580    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 12:27:17.899657 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.899619    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nj5qb\""
Jul 09 12:27:17.899836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.899820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 12:27:17.899874 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.899827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 12:27:17.900157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.900143    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 12:27:17.900275 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.900259    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 12:27:17.900871 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.900858    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 12:27:17.905714 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.905693    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 12:27:17.907003 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.906984    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:27:17.918810 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.918790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.918898 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.918819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.918898 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.918834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.918984 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.918920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.918984 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.918971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9tr\" (UniqueName: \"kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.919054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.919033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:17.919093 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:17.919077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020086 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9tr\" (UniqueName: \"kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020279    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.020988 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.021085 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.020999    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.021085 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.021004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.021249 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.021232    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.022584 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.022564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.022669 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.022641    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.029084 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.029061    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9tr\" (UniqueName: \"kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr\") pod \"console-568f6cb58-hwzp7\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") " pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.206574 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.206469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:18.335356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:18.335335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:27:18.337471 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:27:18.337449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645ab43d_0f63_4aa2_b653_d1baf39b2dce.slice/crio-72c62a8e5f0e7f6bf6960ca64806496c1337202fca3ff65cee86b04da2c92ba5 WatchSource:0}: Error finding container 72c62a8e5f0e7f6bf6960ca64806496c1337202fca3ff65cee86b04da2c92ba5: Status 404 returned error can't find the container with id 72c62a8e5f0e7f6bf6960ca64806496c1337202fca3ff65cee86b04da2c92ba5
Jul 09 12:27:19.281380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:19.281341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f6cb58-hwzp7" event={"ID":"645ab43d-0f63-4aa2-b653-d1baf39b2dce","Type":"ContainerStarted","Data":"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"}
Jul 09 12:27:19.281850 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:19.281391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f6cb58-hwzp7" event={"ID":"645ab43d-0f63-4aa2-b653-d1baf39b2dce","Type":"ContainerStarted","Data":"72c62a8e5f0e7f6bf6960ca64806496c1337202fca3ff65cee86b04da2c92ba5"}
Jul 09 12:27:19.354228 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:19.354172    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568f6cb58-hwzp7" podStartSLOduration=2.354156273 podStartE2EDuration="2.354156273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:27:19.353069833 +0000 UTC m=+155.344200978" watchObservedRunningTime="2026-07-09 12:27:19.354156273 +0000 UTC m=+155.345287422"
Jul 09 12:27:20.330224 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330191    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:20.330608 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330460    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="alertmanager" containerID="cri-o://59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4" gracePeriod=120
Jul 09 12:27:20.330608 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330544    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-metric" containerID="cri-o://88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550" gracePeriod=120
Jul 09 12:27:20.330743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330613    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="config-reloader" containerID="cri-o://9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc" gracePeriod=120
Jul 09 12:27:20.330743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330623    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy" containerID="cri-o://103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942" gracePeriod=120
Jul 09 12:27:20.330743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330560    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="prom-label-proxy" containerID="cri-o://5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7" gracePeriod=120
Jul 09 12:27:20.330743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:20.330592    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-web" containerID="cri-o://2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f" gracePeriod=120
Jul 09 12:27:21.292950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292916    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7" exitCode=0
Jul 09 12:27:21.292950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292941    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550" exitCode=0
Jul 09 12:27:21.292950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292948    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942" exitCode=0
Jul 09 12:27:21.292950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292954    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc" exitCode=0
Jul 09 12:27:21.292950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292959    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4" exitCode=0
Jul 09 12:27:21.293226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.292987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"}
Jul 09 12:27:21.293226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.293053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"}
Jul 09 12:27:21.293226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.293080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"}
Jul 09 12:27:21.293226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.293105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"}
Jul 09 12:27:21.293226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.293129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"}
Jul 09 12:27:21.603870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.603845    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:21.653105 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653078    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653230 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653111    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653230 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653230 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653230 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653197    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653265    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gjsv\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653293    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653389    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653438    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653493    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653532    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"215b93f2-26f4-408e-9267-d141489bd5f7\" (UID: \"215b93f2-26f4-408e-9267-d141489bd5f7\") "
Jul 09 12:27:21.653786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653544    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:21.653786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653765    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:27:21.653982 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653867    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.653982 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.653887    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-alertmanager-main-db\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.654587 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.654552    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:21.656161 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.656110    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume" (OuterVolumeSpecName: "config-volume") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.656547 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.656505    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.656816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.656776    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:27:21.656900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.656842    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.657063 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.657043    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.657197 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.657172    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.657678 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.657652    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv" (OuterVolumeSpecName: "kube-api-access-5gjsv") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "kube-api-access-5gjsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:27:21.657784 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.657676    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out" (OuterVolumeSpecName: "config-out") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:27:21.661055 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.660958    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.667362 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.667337    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config" (OuterVolumeSpecName: "web-config") pod "215b93f2-26f4-408e-9267-d141489bd5f7" (UID: "215b93f2-26f4-408e-9267-d141489bd5f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:21.755087 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755060    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/215b93f2-26f4-408e-9267-d141489bd5f7-config-out\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755087 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755085    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755087 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755095    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-web-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755104    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-config-volume\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755112    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755121    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-tls-assets\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755129    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gjsv\" (UniqueName: \"kubernetes.io/projected/215b93f2-26f4-408e-9267-d141489bd5f7-kube-api-access-5gjsv\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755138    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/215b93f2-26f4-408e-9267-d141489bd5f7-metrics-client-ca\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755147    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-main-tls\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755155    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:21.755294 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:21.755164    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/215b93f2-26f4-408e-9267-d141489bd5f7-cluster-tls-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:22.300662 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.300627    2573 generic.go:356] "Generic (PLEG): container finished" podID="215b93f2-26f4-408e-9267-d141489bd5f7" containerID="2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f" exitCode=0
Jul 09 12:27:22.300842 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.300707    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.300842 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.300708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"}
Jul 09 12:27:22.300842 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.300793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"215b93f2-26f4-408e-9267-d141489bd5f7","Type":"ContainerDied","Data":"e5de2437287dc8b1216118830598dcc95ee94a009eb6e032818d67ec6dfb3254"}
Jul 09 12:27:22.300842 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.300839    2573 scope.go:117] "RemoveContainer" containerID="5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"
Jul 09 12:27:22.309088 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.309053    2573 scope.go:117] "RemoveContainer" containerID="88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"
Jul 09 12:27:22.316181 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.316165    2573 scope.go:117] "RemoveContainer" containerID="103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"
Jul 09 12:27:22.322581 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.322562    2573 scope.go:117] "RemoveContainer" containerID="2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"
Jul 09 12:27:22.325261 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.325202    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:22.330249 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.330234    2573 scope.go:117] "RemoveContainer" containerID="9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"
Jul 09 12:27:22.335455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.332333    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:22.341543 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.341495    2573 scope.go:117] "RemoveContainer" containerID="59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"
Jul 09 12:27:22.348251 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.348237    2573 scope.go:117] "RemoveContainer" containerID="b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a"
Jul 09 12:27:22.354689 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.354673    2573 scope.go:117] "RemoveContainer" containerID="5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"
Jul 09 12:27:22.354916 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.354897    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7\": container with ID starting with 5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7 not found: ID does not exist" containerID="5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"
Jul 09 12:27:22.354971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.354924    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7"} err="failed to get container status \"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7\": rpc error: code = NotFound desc = could not find container \"5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7\": container with ID starting with 5135c2695cecfa8f93669e470adea9cc233a1363ec2b60e0f972e8de974ecfa7 not found: ID does not exist"
Jul 09 12:27:22.354971 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.354940    2573 scope.go:117] "RemoveContainer" containerID="88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"
Jul 09 12:27:22.355173 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.355145    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550\": container with ID starting with 88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550 not found: ID does not exist" containerID="88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"
Jul 09 12:27:22.355238 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355170    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550"} err="failed to get container status \"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550\": rpc error: code = NotFound desc = could not find container \"88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550\": container with ID starting with 88287934b760077d35c293225dd7efb551d27ccc6c99d5c0c92e41f038d82550 not found: ID does not exist"
Jul 09 12:27:22.355238 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355192    2573 scope.go:117] "RemoveContainer" containerID="103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"
Jul 09 12:27:22.355397 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.355378    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942\": container with ID starting with 103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942 not found: ID does not exist" containerID="103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"
Jul 09 12:27:22.355458 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355405    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942"} err="failed to get container status \"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942\": rpc error: code = NotFound desc = could not find container \"103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942\": container with ID starting with 103c9199e106e37dbe4e3935df130ef458a5c6ead48dcf30ec470b4a26948942 not found: ID does not exist"
Jul 09 12:27:22.355458 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355425    2573 scope.go:117] "RemoveContainer" containerID="2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"
Jul 09 12:27:22.355682 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.355666    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f\": container with ID starting with 2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f not found: ID does not exist" containerID="2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"
Jul 09 12:27:22.355755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355688    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f"} err="failed to get container status \"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f\": rpc error: code = NotFound desc = could not find container \"2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f\": container with ID starting with 2ba2bdc94637c02188242332e2d7fa56ae148e7b9362bb8e580e6af268ecb62f not found: ID does not exist"
Jul 09 12:27:22.355755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355706    2573 scope.go:117] "RemoveContainer" containerID="9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"
Jul 09 12:27:22.355936 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.355920    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc\": container with ID starting with 9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc not found: ID does not exist" containerID="9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"
Jul 09 12:27:22.355990 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355947    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc"} err="failed to get container status \"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc\": rpc error: code = NotFound desc = could not find container \"9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc\": container with ID starting with 9440b612449cd3319e686a2ec2ba422ceaaad1be78e036597ee7f628c0e27fbc not found: ID does not exist"
Jul 09 12:27:22.355990 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.355960    2573 scope.go:117] "RemoveContainer" containerID="59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"
Jul 09 12:27:22.356130 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.356114    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4\": container with ID starting with 59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4 not found: ID does not exist" containerID="59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"
Jul 09 12:27:22.356190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.356136    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4"} err="failed to get container status \"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4\": rpc error: code = NotFound desc = could not find container \"59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4\": container with ID starting with 59656d4a2e7d3a1067d14dc412416b7cb07c1fbe853c2ab491c918a0286d96a4 not found: ID does not exist"
Jul 09 12:27:22.356190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.356155    2573 scope.go:117] "RemoveContainer" containerID="b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a"
Jul 09 12:27:22.356384 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:22.356366    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a\": container with ID starting with b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a not found: ID does not exist" containerID="b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a"
Jul 09 12:27:22.356420 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.356389    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a"} err="failed to get container status \"b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a\": rpc error: code = NotFound desc = could not find container \"b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a\": container with ID starting with b64e06dd584279f967dd713923735aa56e7130e7fce47ecd59116ac84c9f5b4a not found: ID does not exist"
Jul 09 12:27:22.374226 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374198    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:22.374529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374494    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-metric"
Jul 09 12:27:22.374529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374521    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-metric"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374537    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374543    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374552    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="init-config-reloader"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374557    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="init-config-reloader"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374563    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-web"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374568    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-web"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374575    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="prom-label-proxy"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374581    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="prom-label-proxy"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374589    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="config-reloader"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374593    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="config-reloader"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374604    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="alertmanager"
Jul 09 12:27:22.374612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374608    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="alertmanager"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374650    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="alertmanager"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374657    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-web"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374664    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374671    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="config-reloader"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374677    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="kube-rbac-proxy-metric"
Jul 09 12:27:22.374976 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.374683    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" containerName="prom-label-proxy"
Jul 09 12:27:22.412438 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.412393    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:22.412559 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.412547    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.415627 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 12:27:22.415746 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415630    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 12:27:22.415746 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9t8cc\""
Jul 09 12:27:22.415746 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 12:27:22.415921 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415784    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 12:27:22.415921 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415848    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 12:27:22.415921 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 12:27:22.416095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.415962    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 12:27:22.416334 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.416319    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 12:27:22.421710 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.421693    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 12:27:22.461577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461577 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-web-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw6g6\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-kube-api-access-bw6g6\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461937 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461937 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461937 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-out\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.461937 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.462102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.462102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.461972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-volume\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.462102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.462005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562770 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw6g6\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-kube-api-access-bw6g6\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562860 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562860 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-out\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.562973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-volume\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.562974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-web-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563502 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563480    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.563841 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.563815    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.566789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.565822    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-out\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.566789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.566294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-web-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.566789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.566619    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.566789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.566723    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-config-volume\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.566789 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.566728    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.567301 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.567276    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.567695 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.567665    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.567985 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.567965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.568056 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.567969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2656704e-a45a-4cc2-99f9-b94dd9564b09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.568277 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.568251    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="215b93f2-26f4-408e-9267-d141489bd5f7" path="/var/lib/kubelet/pods/215b93f2-26f4-408e-9267-d141489bd5f7/volumes"
Jul 09 12:27:22.569058 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.569038    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2656704e-a45a-4cc2-99f9-b94dd9564b09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.572461 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.572438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw6g6\" (UniqueName: \"kubernetes.io/projected/2656704e-a45a-4cc2-99f9-b94dd9564b09-kube-api-access-bw6g6\") pod \"alertmanager-main-0\" (UID: \"2656704e-a45a-4cc2-99f9-b94dd9564b09\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.723033 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.722999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 12:27:22.900184 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:22.900164    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 12:27:22.902209 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:27:22.902184    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2656704e_a45a_4cc2_99f9_b94dd9564b09.slice/crio-bab2773b402501647fe1ebf4448a1f82dd8cdfe74a298b2deb4a79466bc504d6 WatchSource:0}: Error finding container bab2773b402501647fe1ebf4448a1f82dd8cdfe74a298b2deb4a79466bc504d6: Status 404 returned error can't find the container with id bab2773b402501647fe1ebf4448a1f82dd8cdfe74a298b2deb4a79466bc504d6
Jul 09 12:27:23.307916 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:23.307885    2573 generic.go:356] "Generic (PLEG): container finished" podID="2656704e-a45a-4cc2-99f9-b94dd9564b09" containerID="ebb40bbd1543607fde3cf11c89ad37e2e4904f16831b1b835bc368c1db1e1c0b" exitCode=0
Jul 09 12:27:23.308102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:23.307985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerDied","Data":"ebb40bbd1543607fde3cf11c89ad37e2e4904f16831b1b835bc368c1db1e1c0b"}
Jul 09 12:27:23.308102 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:23.308049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"bab2773b402501647fe1ebf4448a1f82dd8cdfe74a298b2deb4a79466bc504d6"}
Jul 09 12:27:24.315357 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"0f5c3b509bb367ce03c3ca59017c73d0a8d1a7aacfb3ed50c84f35947aa2288b"}
Jul 09 12:27:24.315829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"03cfc4a754a038c94309076fef9705a96a5e0cf98d50eb98157e7a2facb8ed01"}
Jul 09 12:27:24.315829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"2a79c0926f8fe1178a5afef2fdbf6397b163e3511de7f447c4c2fa56916e8f0a"}
Jul 09 12:27:24.315829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"d70ef9a6eaad94e926cefe3c71530d4069ba3b4b966134a68cca17a2fb095a94"}
Jul 09 12:27:24.315829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"ca6b5393f77f8e5c7682ba14f42dce418f3e0a6d171e919715d6dc7b2887149b"}
Jul 09 12:27:24.315829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.315551    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2656704e-a45a-4cc2-99f9-b94dd9564b09","Type":"ContainerStarted","Data":"f8f6fc440124c17bc2e559c40c6900d68116ef8bb4056179410cb1dcb4f51793"}
Jul 09 12:27:24.372118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.372056    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.359407277 podStartE2EDuration="2.372034556s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.627279ms" isStatefulPod=false podCreationTimestamp="2026-07-09 12:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:27:24.370142678 +0000 UTC m=+160.361273831" watchObservedRunningTime="2026-07-09 12:27:24.372034556 +0000 UTC m=+160.363165707"
Jul 09 12:27:24.582966 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.582879    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:24.583194 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583164    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="prometheus" containerID="cri-o://f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38" gracePeriod=600
Jul 09 12:27:24.583194 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583178    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy" containerID="cri-o://896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2" gracePeriod=600
Jul 09 12:27:24.583389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583205    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-web" containerID="cri-o://ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067" gracePeriod=600
Jul 09 12:27:24.583389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583200    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="thanos-sidecar" containerID="cri-o://a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45" gracePeriod=600
Jul 09 12:27:24.583389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583248    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-thanos" containerID="cri-o://52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9" gracePeriod=600
Jul 09 12:27:24.583389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.583250    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="config-reloader" containerID="cri-o://d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11" gracePeriod=600
Jul 09 12:27:24.820678 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.820655    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:24.884902 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.884826    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.884902 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.884858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.884902 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.884891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885164 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.884909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885164 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885018    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885164 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885053    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885164 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885081    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885164 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885139    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885165    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm2hk\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885250    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885276    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885362    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885416 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885409    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885827 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885431    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885827 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885827 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885502    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.885827 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.885541    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out\") pod \"06bcdbee-7f6b-4980-a45b-a0544da23184\" (UID: \"06bcdbee-7f6b-4980-a45b-a0544da23184\") "
Jul 09 12:27:24.887067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.886227    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:27:24.887067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.886294    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.887067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.886711    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.887067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.886948    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.887425 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.887109    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.887425 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.887300    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.888073 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.888041    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.889178 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.888199    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out" (OuterVolumeSpecName: "config-out") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:27:24.889178 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.888552    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:27:24.889178 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.888933    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.889731 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.889695    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.890836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.890323    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.890836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.890786    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:27:24.891105 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.891080    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.891301 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.891274    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.891554 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.891527    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.891688 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.891667    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config" (OuterVolumeSpecName: "config") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.891888 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.891868    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk" (OuterVolumeSpecName: "kube-api-access-qm2hk") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "kube-api-access-qm2hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:27:24.892157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.892137    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.900278 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.900257    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config" (OuterVolumeSpecName: "web-config") pod "06bcdbee-7f6b-4980-a45b-a0544da23184" (UID: "06bcdbee-7f6b-4980-a45b-a0544da23184"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:27:24.986386 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986355    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-kube-rbac-proxy\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986386 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986385    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986386 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986395    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-config-out\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986403    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-metrics-client-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986412    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-tls-assets\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986420    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986428    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-db\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986437    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-web-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986446    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986455    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986463    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986471    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm2hk\" (UniqueName: \"kubernetes.io/projected/06bcdbee-7f6b-4980-a45b-a0544da23184-kube-api-access-qm2hk\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986480    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986487    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986496    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986506    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-metrics-client-ca\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986528    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986536    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06bcdbee-7f6b-4980-a45b-a0544da23184-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986546    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:24.986607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:24.986554    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06bcdbee-7f6b-4980-a45b-a0544da23184-secret-grpc-tls\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:27:25.322469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322438    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9" exitCode=0
Jul 09 12:27:25.322469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322462    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2" exitCode=0
Jul 09 12:27:25.322469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322468    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067" exitCode=0
Jul 09 12:27:25.322469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322473    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45" exitCode=0
Jul 09 12:27:25.322469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322479    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11" exitCode=0
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322484    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38" exitCode=0
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322532    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322722    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"}
Jul 09 12:27:25.323011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.322811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06bcdbee-7f6b-4980-a45b-a0544da23184","Type":"ContainerDied","Data":"57cac98c2c189c9fe03f9d93b07c88db3ea9ac906de0ef3bb0f89f9156fe8d79"}
Jul 09 12:27:25.331191 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.331170    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.339419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.339401    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.345975 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.345960    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.352710 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.352685    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.354340 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.354325    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:25.359606 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.359585    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.366149 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.366126    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:25.367018 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.367002    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.373370 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.373353    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.373704 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.373680    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.373766 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.373716    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.373766 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.373741    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.374001 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.373984    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.374037 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374010    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.374037 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374028    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.374275 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.374258    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.374312 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374281    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.374312 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374295    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.374545 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.374529    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.374584 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374549    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.374584 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374562    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.374778 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.374762    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.374819 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374783    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.374819 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374796    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.374984 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.374970    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.375020 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.374989    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.375020 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375002    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.375238 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:27:25.375222    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.375299 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375245    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.375299 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375268    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.375477 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375460    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.375559 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375478    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.375692 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375676    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.375737 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375693    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.375876 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375858    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.375913 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.375876    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.376073 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376059    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.376119 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376076    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.376260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376245    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.376311 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376260    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.376445 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376431    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.376482 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376445    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.376643 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.376680 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376644    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.376809 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376794    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.376809 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376808    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.376980 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376955    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.376980 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.376973    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.377140 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377127    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.377180 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377140    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.377300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377284    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.377336 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377300    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.377474 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377458    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.377529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377475    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.377688 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377672    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.377688 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377687    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.377864 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377851    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.377909 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.377864    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.378042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378027    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.378083 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378043    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.378203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378190    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.378244 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378205    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.378385 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378368    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.378429 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378386    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.378586 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378571    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.378638 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378586    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.378781 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378766    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.378830 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378781    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.378977 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378961    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.379011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.378977    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.379148 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379134    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.379186 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379148    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.379347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379331    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.379347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379347    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.379549 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379532    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.379595 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379549    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.379721 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379707    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.379757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379722    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.379897 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379882    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.379937 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.379896    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.380077 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380061    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.380113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380077    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.380239 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380224    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.380281 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380239    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.380404 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380389    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.380443 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380404    2573 scope.go:117] "RemoveContainer" containerID="52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"
Jul 09 12:27:25.380587 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380571    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9"} err="failed to get container status \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": rpc error: code = NotFound desc = could not find container \"52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9\": container with ID starting with 52eda31ac8b9af6f1bac551d455257f7c423d3d4cdc7d338c8d4bc9d69245cb9 not found: ID does not exist"
Jul 09 12:27:25.380631 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380587    2573 scope.go:117] "RemoveContainer" containerID="896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"
Jul 09 12:27:25.380780 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380740    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2"} err="failed to get container status \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": rpc error: code = NotFound desc = could not find container \"896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2\": container with ID starting with 896c1b49f415727d519f44251b9afbb3cc267775a474fd5fa2ee5978201cadc2 not found: ID does not exist"
Jul 09 12:27:25.380780 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380756    2573 scope.go:117] "RemoveContainer" containerID="ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"
Jul 09 12:27:25.380916 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380902    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067"} err="failed to get container status \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": rpc error: code = NotFound desc = could not find container \"ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067\": container with ID starting with ae3a80a97397eb8b6e69afc3b2aa3005da817e688b86ece02e011daea7b15067 not found: ID does not exist"
Jul 09 12:27:25.380951 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.380917    2573 scope.go:117] "RemoveContainer" containerID="a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"
Jul 09 12:27:25.381085 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381070    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45"} err="failed to get container status \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": rpc error: code = NotFound desc = could not find container \"a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45\": container with ID starting with a0ed712b7bfde7c46a498c47f2ac7ef2751c34a06c2a8efda2fa05add17abb45 not found: ID does not exist"
Jul 09 12:27:25.381121 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381085    2573 scope.go:117] "RemoveContainer" containerID="d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"
Jul 09 12:27:25.381257 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381241    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11"} err="failed to get container status \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": rpc error: code = NotFound desc = could not find container \"d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11\": container with ID starting with d1ddc5c22caaf7f70692455044c3f3b00d4e92c2b650a66f040d18f5cb5c7e11 not found: ID does not exist"
Jul 09 12:27:25.381300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381257    2573 scope.go:117] "RemoveContainer" containerID="f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"
Jul 09 12:27:25.381449 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381433    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38"} err="failed to get container status \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": rpc error: code = NotFound desc = could not find container \"f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38\": container with ID starting with f3093581c379adf6190529df150417dedc36e61819d114dc7f7bbc1fb7329b38 not found: ID does not exist"
Jul 09 12:27:25.381449 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381449    2573 scope.go:117] "RemoveContainer" containerID="1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"
Jul 09 12:27:25.381642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.381627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198"} err="failed to get container status \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": rpc error: code = NotFound desc = could not find container \"1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198\": container with ID starting with 1bac68fdaafe896eb0e61341f17d454dd77563d738642189a46f0ca6507cb198 not found: ID does not exist"
Jul 09 12:27:25.415407 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415382    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:25.415740 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415726    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="config-reloader"
Jul 09 12:27:25.415785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415743    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="config-reloader"
Jul 09 12:27:25.415785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415751    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy"
Jul 09 12:27:25.415785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415757    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy"
Jul 09 12:27:25.415785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415769    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="prometheus"
Jul 09 12:27:25.415785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415779    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="prometheus"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415791    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-thanos"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415796    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-thanos"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415802    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="init-config-reloader"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415807    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="init-config-reloader"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415817    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="thanos-sidecar"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415823    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="thanos-sidecar"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415829    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-web"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415834    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-web"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415893    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-thanos"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415903    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="config-reloader"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415910    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="prometheus"
Jul 09 12:27:25.415919 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415915    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy"
Jul 09 12:27:25.416242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415924    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="thanos-sidecar"
Jul 09 12:27:25.416242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.415932    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" containerName="kube-rbac-proxy-web"
Jul 09 12:27:25.419868 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.419852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.422987 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.422971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 12:27:25.423063 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.423041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 12:27:25.423245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.423230    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 12:27:25.423245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.423237    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 12:27:25.423977 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.423962    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 12:27:25.424361 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.424343    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p4hnx\""
Jul 09 12:27:25.424439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.424423    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 12:27:25.426458 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426425    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 12:27:25.426563 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426539    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a2nr1b7uuoa6k\""
Jul 09 12:27:25.426659 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426642    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 12:27:25.426716 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426708    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 12:27:25.426867 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426853    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 12:27:25.426922 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426904    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 12:27:25.426962 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.426956    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 12:27:25.429591 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.429570    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 12:27:25.432469 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.432454    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 12:27:25.440157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.440135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:25.490920 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.490887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.490920 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.490925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.490944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.490963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkwc\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-kube-api-access-rmkwc\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-config-out\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491233    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.491363 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.491361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-web-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkwc\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-kube-api-access-rmkwc\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592396 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592396 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592412    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-config-out\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592903 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592809    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.592958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.592910    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.593233 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.593206    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.593575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.593551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.593877 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.593848    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595352 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595327    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-config-out\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595435 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595435 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595435 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595427    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595639 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595639 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595639 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595639 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595639 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-web-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.595887 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.595785    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.596421 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.596290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.596581 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.596446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.597011 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.596940    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.597850 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.597810    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.598080 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.598061    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.598234 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.598212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-web-config\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.598384 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.598341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/582d2a3f-2ede-4dc3-8666-692c37035063-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.598869 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.598847    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.598925 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.598878    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/582d2a3f-2ede-4dc3-8666-692c37035063-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.601339 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.601320    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkwc\" (UniqueName: \"kubernetes.io/projected/582d2a3f-2ede-4dc3-8666-692c37035063-kube-api-access-rmkwc\") pod \"prometheus-k8s-0\" (UID: \"582d2a3f-2ede-4dc3-8666-692c37035063\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.729629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.729604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:27:25.880433 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:25.880408    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 12:27:25.882597 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:27:25.882575    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582d2a3f_2ede_4dc3_8666_692c37035063.slice/crio-f6362f79449f6bb4a080412fea4c2e756bbd89ccf5b6a613b68f8bcb4bdcd21d WatchSource:0}: Error finding container f6362f79449f6bb4a080412fea4c2e756bbd89ccf5b6a613b68f8bcb4bdcd21d: Status 404 returned error can't find the container with id f6362f79449f6bb4a080412fea4c2e756bbd89ccf5b6a613b68f8bcb4bdcd21d
Jul 09 12:27:26.329719 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:26.329685    2573 generic.go:356] "Generic (PLEG): container finished" podID="582d2a3f-2ede-4dc3-8666-692c37035063" containerID="86dc889ad6beb12d7f7d5639d91b53ba490a9a7a928922e73b831ce37ec5c136" exitCode=0
Jul 09 12:27:26.330166 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:26.329743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerDied","Data":"86dc889ad6beb12d7f7d5639d91b53ba490a9a7a928922e73b831ce37ec5c136"}
Jul 09 12:27:26.330166 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:26.329814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"f6362f79449f6bb4a080412fea4c2e756bbd89ccf5b6a613b68f8bcb4bdcd21d"}
Jul 09 12:27:26.573445 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:26.573414    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bcdbee-7f6b-4980-a45b-a0544da23184" path="/var/lib/kubelet/pods/06bcdbee-7f6b-4980-a45b-a0544da23184/volumes"
Jul 09 12:27:27.337621 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"e0e8595d211b01356463afa6a3a8f4cc5efebf8c3e4ae070fcad99354ea72bf6"}
Jul 09 12:27:27.338042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"25ea69ce9870141337cca2a159efe2d5f10a467a2e777785df531569f123ba95"}
Jul 09 12:27:27.338042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"fef955b62cf18b99a7d749d96dea5a55b0f79a8d64e9238a8def34cf159b38a9"}
Jul 09 12:27:27.338042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"af84f401a6a33c4979f32c1dc0e9991ccb94e8c979cea8fbb27bc6c85c9937c2"}
Jul 09 12:27:27.338042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"7a3082b5359c349be46730265b8dc723a57261f3c7aea6e7fb251ad91550e639"}
Jul 09 12:27:27.338042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.337744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"582d2a3f-2ede-4dc3-8666-692c37035063","Type":"ContainerStarted","Data":"2d1c1de41c767659f39fdb2df15fe556dd996563901a256691113f2ea5578f99"}
Jul 09 12:27:27.391455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:27.391395    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.373837528 podStartE2EDuration="2.391375386s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.537858ms" isStatefulPod=false podCreationTimestamp="2026-07-09 12:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:27:27.389043033 +0000 UTC m=+163.380174193" watchObservedRunningTime="2026-07-09 12:27:27.391375386 +0000 UTC m=+163.382506537"
Jul 09 12:27:28.207061 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:28.207018    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:28.207307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:28.207080    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:28.211667 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:28.211639    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:28.348060 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:28.348032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:27:30.204261 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:30.204230    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pxv45"
Jul 09 12:27:30.730549 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:27:30.730500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:28:25.729957 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.729899    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:28:25.745779 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.745749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:28:25.945904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.945868    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"]
Jul 09 12:28:25.949807 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.949790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:25.952481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.952456    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 12:28:25.952622 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.952521    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfw5w\""
Jul 09 12:28:25.952622 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.952545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 12:28:25.959368 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:25.959348    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"]
Jul 09 12:28:26.116847 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.116773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb44g\" (UniqueName: \"kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.116847 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.116839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.117018 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.116885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.217986 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.217951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.218122 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.218001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb44g\" (UniqueName: \"kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.218122 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.218047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.218341 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.218322    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.218388 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.218369    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.227451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.227421    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb44g\" (UniqueName: \"kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.258975 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.258952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:26.392019 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.391841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"]
Jul 09 12:28:26.394833 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:28:26.394799    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4fdf78_d6a0_4148_829a_090e26ead14c.slice/crio-45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c WatchSource:0}: Error finding container 45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c: Status 404 returned error can't find the container with id 45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c
Jul 09 12:28:26.571801 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.571770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn" event={"ID":"2b4fdf78-d6a0-4148-829a-090e26ead14c","Type":"ContainerStarted","Data":"45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c"}
Jul 09 12:28:26.587044 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:26.587020    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 12:28:34.606300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:34.606221    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerID="2a7d0dcf6b42867d7a8b205d6a31eeca21ca1421f513cf215bd0adc9d7280741" exitCode=0
Jul 09 12:28:34.606300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:34.606272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn" event={"ID":"2b4fdf78-d6a0-4148-829a-090e26ead14c","Type":"ContainerDied","Data":"2a7d0dcf6b42867d7a8b205d6a31eeca21ca1421f513cf215bd0adc9d7280741"}
Jul 09 12:28:37.620505 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:37.620471    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerID="216b6d344b9a9aa027c30b337ed62052300b0f9623b8c2aee66d57869eaccf3c" exitCode=0
Jul 09 12:28:37.620505 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:37.620524    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn" event={"ID":"2b4fdf78-d6a0-4148-829a-090e26ead14c","Type":"ContainerDied","Data":"216b6d344b9a9aa027c30b337ed62052300b0f9623b8c2aee66d57869eaccf3c"}
Jul 09 12:28:45.659612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:45.659575    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerID="4e3e8547398e66b0edc98400c2c7b3e6ae117cbda5e1d00023c5fa7ed0544726" exitCode=0
Jul 09 12:28:45.659975 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:45.659655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn" event={"ID":"2b4fdf78-d6a0-4148-829a-090e26ead14c","Type":"ContainerDied","Data":"4e3e8547398e66b0edc98400c2c7b3e6ae117cbda5e1d00023c5fa7ed0544726"}
Jul 09 12:28:46.781952 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.781930    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:46.794659 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.794639    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb44g\" (UniqueName: \"kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g\") pod \"2b4fdf78-d6a0-4148-829a-090e26ead14c\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") "
Jul 09 12:28:46.794745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.794674    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util\") pod \"2b4fdf78-d6a0-4148-829a-090e26ead14c\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") "
Jul 09 12:28:46.794745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.794736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle\") pod \"2b4fdf78-d6a0-4148-829a-090e26ead14c\" (UID: \"2b4fdf78-d6a0-4148-829a-090e26ead14c\") "
Jul 09 12:28:46.795351 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.795327    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle" (OuterVolumeSpecName: "bundle") pod "2b4fdf78-d6a0-4148-829a-090e26ead14c" (UID: "2b4fdf78-d6a0-4148-829a-090e26ead14c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:28:46.796656 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.796635    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g" (OuterVolumeSpecName: "kube-api-access-vb44g") pod "2b4fdf78-d6a0-4148-829a-090e26ead14c" (UID: "2b4fdf78-d6a0-4148-829a-090e26ead14c"). InnerVolumeSpecName "kube-api-access-vb44g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:28:46.800502 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.800472    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util" (OuterVolumeSpecName: "util") pod "2b4fdf78-d6a0-4148-829a-090e26ead14c" (UID: "2b4fdf78-d6a0-4148-829a-090e26ead14c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:28:46.896138 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.896108    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb44g\" (UniqueName: \"kubernetes.io/projected/2b4fdf78-d6a0-4148-829a-090e26ead14c-kube-api-access-vb44g\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:28:46.896138 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.896132    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:28:46.896138 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:46.896141    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4fdf78-d6a0-4148-829a-090e26ead14c-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:28:47.669409 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:47.669381    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn"
Jul 09 12:28:47.669583 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:47.669379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrkjn" event={"ID":"2b4fdf78-d6a0-4148-829a-090e26ead14c","Type":"ContainerDied","Data":"45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c"}
Jul 09 12:28:47.669583 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:28:47.669501    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45d0785950da82cc42b8e2c82d7aa0a0eec262667c529691fcf3b3852a04af0c"
Jul 09 12:29:01.486809 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.486773    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"]
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487094    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="pull"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487104    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="pull"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487116    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="extract"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487121    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="extract"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487134    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="util"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487141    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="util"
Jul 09 12:29:01.487245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.487196    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4fdf78-d6a0-4148-829a-090e26ead14c" containerName="extract"
Jul 09 12:29:01.490958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.490935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.492478 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.492455    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5fqd6"]
Jul 09 12:29:01.494575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.494558    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.494865 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.494848    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 12:29:01.495494 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.495480    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfw5w\""
Jul 09 12:29:01.495687 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.495668    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 12:29:01.497234 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.497215    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gh5n9\""
Jul 09 12:29:01.497326 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.497277    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 12:29:01.497642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.497625    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 12:29:01.507399 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.507377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"]
Jul 09 12:29:01.513973 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.513951    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5fqd6"]
Jul 09 12:29:01.524462 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.524442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.524555 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.524483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.524615 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.524569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpc54\" (UniqueName: \"kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.625257 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.625444 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.625444 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.625444 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgrr\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-kube-api-access-4jgrr\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.625444 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpc54\" (UniqueName: \"kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.625732 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625710    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.625774 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.625721    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.648539 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.648495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpc54\" (UniqueName: \"kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.726231 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.726200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgrr\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-kube-api-access-4jgrr\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.726388 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.726297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.741821 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.741756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgrr\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-kube-api-access-4jgrr\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.747419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.747397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/041960d5-0cd2-4332-a119-135ca5281baf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5fqd6\" (UID: \"041960d5-0cd2-4332-a119-135ca5281baf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.800420 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.800384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:01.816714 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.816679    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:01.951642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.951613    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"]
Jul 09 12:29:01.953187 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:01.953165    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e75b321_af5c_4a9d_87a3_d4a9e62d29b6.slice/crio-f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012 WatchSource:0}: Error finding container f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012: Status 404 returned error can't find the container with id f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012
Jul 09 12:29:01.975311 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:01.975287    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5fqd6"]
Jul 09 12:29:01.988592 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:01.988560    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod041960d5_0cd2_4332_a119_135ca5281baf.slice/crio-97f0e4e06ae810e04139d4f019eb49db6396fcd34d5f1c0669251cffe297e66e WatchSource:0}: Error finding container 97f0e4e06ae810e04139d4f019eb49db6396fcd34d5f1c0669251cffe297e66e: Status 404 returned error can't find the container with id 97f0e4e06ae810e04139d4f019eb49db6396fcd34d5f1c0669251cffe297e66e
Jul 09 12:29:02.731627 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:02.731535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6" event={"ID":"041960d5-0cd2-4332-a119-135ca5281baf","Type":"ContainerStarted","Data":"97f0e4e06ae810e04139d4f019eb49db6396fcd34d5f1c0669251cffe297e66e"}
Jul 09 12:29:02.733195 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:02.733154    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerID="e8c87bcaddd56a5bcee4360dfa960dab22777be31ff1d999b9231302c81172b2" exitCode=0
Jul 09 12:29:02.733319 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:02.733189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx" event={"ID":"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6","Type":"ContainerDied","Data":"e8c87bcaddd56a5bcee4360dfa960dab22777be31ff1d999b9231302c81172b2"}
Jul 09 12:29:02.733319 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:02.733241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx" event={"ID":"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6","Type":"ContainerStarted","Data":"f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012"}
Jul 09 12:29:03.163667 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.163583    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"]
Jul 09 12:29:03.165859 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.165837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.169118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.169097    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s47pn\""
Jul 09 12:29:03.188110 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.188080    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"]
Jul 09 12:29:03.237807 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.237696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s95g\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-kube-api-access-2s95g\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.237807 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.237779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.338972 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.338933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s95g\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-kube-api-access-2s95g\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.339128 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.338984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.350698 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.350671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s95g\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-kube-api-access-2s95g\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.350840 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.350823    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25b1e8e0-b430-4fea-baa0-0036a28235ad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxllc\" (UID: \"25b1e8e0-b430-4fea-baa0-0036a28235ad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.475193 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.475115    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"
Jul 09 12:29:03.625951 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.625847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxllc"]
Jul 09 12:29:03.628423 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:03.628392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25b1e8e0_b430_4fea_baa0_0036a28235ad.slice/crio-1bdfb7a8cffe73060ef8283bd8feb5a0370c6379239421b2261ab531013e7e34 WatchSource:0}: Error finding container 1bdfb7a8cffe73060ef8283bd8feb5a0370c6379239421b2261ab531013e7e34: Status 404 returned error can't find the container with id 1bdfb7a8cffe73060ef8283bd8feb5a0370c6379239421b2261ab531013e7e34
Jul 09 12:29:03.743003 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:03.742966    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc" event={"ID":"25b1e8e0-b430-4fea-baa0-0036a28235ad","Type":"ContainerStarted","Data":"1bdfb7a8cffe73060ef8283bd8feb5a0370c6379239421b2261ab531013e7e34"}
Jul 09 12:29:06.757834 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.757750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6" event={"ID":"041960d5-0cd2-4332-a119-135ca5281baf","Type":"ContainerStarted","Data":"5778934cb161e6c1802471edf90c4c4b24be1123ba587467021815f95e01c56e"}
Jul 09 12:29:06.758221 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.757889    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:06.759261 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.759237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc" event={"ID":"25b1e8e0-b430-4fea-baa0-0036a28235ad","Type":"ContainerStarted","Data":"cc3942fdd4b4c33b7de47ce42cb896efb023b6fd763c8495b3195d92fd62f0a4"}
Jul 09 12:29:06.760933 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.760911    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerID="3850dda88ce6323684ec57d6cbcc97533655562173b7a52ce2e6ff912028f3c2" exitCode=0
Jul 09 12:29:06.761020 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.760998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx" event={"ID":"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6","Type":"ContainerDied","Data":"3850dda88ce6323684ec57d6cbcc97533655562173b7a52ce2e6ff912028f3c2"}
Jul 09 12:29:06.803112 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.803056    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6" podStartSLOduration=2.114655439 podStartE2EDuration="5.803034668s" totalImagesPullingTime="3.688379229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:29:06.781269584 +0000 UTC m=+262.772400753" watchObservedRunningTime="2026-07-09 12:29:06.803034668 +0000 UTC m=+262.794165820"
Jul 09 12:29:06.804686 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:06.804650    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxllc" podStartSLOduration=1.742831721 podStartE2EDuration="3.804638751s" totalImagesPullingTime="2.06180703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:29:06.803387056 +0000 UTC m=+262.794518208" watchObservedRunningTime="2026-07-09 12:29:06.804638751 +0000 UTC m=+262.795769901"
Jul 09 12:29:07.766798 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:07.766765    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerID="7a1e55c6850f4434552df0e487ddcb50c6c23543f1b3c508778f100d5d480dcf" exitCode=0
Jul 09 12:29:07.767230 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:07.766855    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx" event={"ID":"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6","Type":"ContainerDied","Data":"7a1e55c6850f4434552df0e487ddcb50c6c23543f1b3c508778f100d5d480dcf"}
Jul 09 12:29:08.893876 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.893851    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:08.990904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.990875    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpc54\" (UniqueName: \"kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54\") pod \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") "
Jul 09 12:29:08.991031 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.990938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle\") pod \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") "
Jul 09 12:29:08.991031 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.990964    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util\") pod \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\" (UID: \"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6\") "
Jul 09 12:29:08.991268 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.991246    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle" (OuterVolumeSpecName: "bundle") pod "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" (UID: "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:29:08.992945 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.992918    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54" (OuterVolumeSpecName: "kube-api-access-rpc54") pod "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" (UID: "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6"). InnerVolumeSpecName "kube-api-access-rpc54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:29:08.996042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:08.996002    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util" (OuterVolumeSpecName: "util") pod "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" (UID: "5e75b321-af5c-4a9d-87a3-d4a9e62d29b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:29:09.092401 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.092334    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpc54\" (UniqueName: \"kubernetes.io/projected/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-kube-api-access-rpc54\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:09.092401 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.092367    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:09.092401 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.092376    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e75b321-af5c-4a9d-87a3-d4a9e62d29b6-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:09.776525 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.776484    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx"
Jul 09 12:29:09.776525 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.776500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzjmx" event={"ID":"5e75b321-af5c-4a9d-87a3-d4a9e62d29b6","Type":"ContainerDied","Data":"f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012"}
Jul 09 12:29:09.776734 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:09.776571    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3b266d352ff410caf0582bff081334de8cc88b061b90f1b0b614fff820b0012"
Jul 09 12:29:12.768949 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:12.768917    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5fqd6"
Jul 09 12:29:20.370126 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370089    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"]
Jul 09 12:29:20.370665 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370636    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="util"
Jul 09 12:29:20.370665 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370656    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="util"
Jul 09 12:29:20.370792 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370699    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="extract"
Jul 09 12:29:20.370792 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370708    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="extract"
Jul 09 12:29:20.370792 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370719    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="pull"
Jul 09 12:29:20.370792 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370728    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="pull"
Jul 09 12:29:20.370984 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.370810    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e75b321-af5c-4a9d-87a3-d4a9e62d29b6" containerName="extract"
Jul 09 12:29:20.403596 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.403569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"]
Jul 09 12:29:20.403757 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.403673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.406909 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.406885    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 12:29:20.407212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.407195    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 12:29:20.407553 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.407532    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfw5w\""
Jul 09 12:29:20.497088 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.497051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.497259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.497099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m766\" (UniqueName: \"kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.497259 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.497186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.597996 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.597961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.598132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.598007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m766\" (UniqueName: \"kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.598132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.598045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.598419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.598389    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.598456 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.598403    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.608680 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.608651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m766\" (UniqueName: \"kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.712404 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.712326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:20.859553 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:20.859528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"]
Jul 09 12:29:20.862013 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:20.861984    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d76609f_349c_4575_b1a2_be232805d9cc.slice/crio-42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f WatchSource:0}: Error finding container 42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f: Status 404 returned error can't find the container with id 42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f
Jul 09 12:29:21.829123 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:21.829087    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d76609f-349c-4575-b1a2-be232805d9cc" containerID="f140d5dbdb23ee395859f3d6843f2ff1a419b05e0eb7dcc24606637f87da0ffd" exitCode=0
Jul 09 12:29:21.829123 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:21.829127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r" event={"ID":"6d76609f-349c-4575-b1a2-be232805d9cc","Type":"ContainerDied","Data":"f140d5dbdb23ee395859f3d6843f2ff1a419b05e0eb7dcc24606637f87da0ffd"}
Jul 09 12:29:21.829578 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:21.829170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r" event={"ID":"6d76609f-349c-4575-b1a2-be232805d9cc","Type":"ContainerStarted","Data":"42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f"}
Jul 09 12:29:22.835890 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:22.835855    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d76609f-349c-4575-b1a2-be232805d9cc" containerID="4c6e088a65b40a76816c5a958f7358414219f512b035f669df06560264f73868" exitCode=0
Jul 09 12:29:22.836270 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:22.835934    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r" event={"ID":"6d76609f-349c-4575-b1a2-be232805d9cc","Type":"ContainerDied","Data":"4c6e088a65b40a76816c5a958f7358414219f512b035f669df06560264f73868"}
Jul 09 12:29:23.842118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:23.842081    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d76609f-349c-4575-b1a2-be232805d9cc" containerID="dfeb54b138e56d0731939ca779d28a307b547348d3ab2176289a85a4f138b158" exitCode=0
Jul 09 12:29:23.842463 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:23.842152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r" event={"ID":"6d76609f-349c-4575-b1a2-be232805d9cc","Type":"ContainerDied","Data":"dfeb54b138e56d0731939ca779d28a307b547348d3ab2176289a85a4f138b158"}
Jul 09 12:29:24.964811 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:24.964787    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:25.144202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.144115    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle\") pod \"6d76609f-349c-4575-b1a2-be232805d9cc\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") "
Jul 09 12:29:25.144202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.144174    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util\") pod \"6d76609f-349c-4575-b1a2-be232805d9cc\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") "
Jul 09 12:29:25.144414 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.144249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m766\" (UniqueName: \"kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766\") pod \"6d76609f-349c-4575-b1a2-be232805d9cc\" (UID: \"6d76609f-349c-4575-b1a2-be232805d9cc\") "
Jul 09 12:29:25.144807 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.144783    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle" (OuterVolumeSpecName: "bundle") pod "6d76609f-349c-4575-b1a2-be232805d9cc" (UID: "6d76609f-349c-4575-b1a2-be232805d9cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:29:25.146315 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.146288    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766" (OuterVolumeSpecName: "kube-api-access-7m766") pod "6d76609f-349c-4575-b1a2-be232805d9cc" (UID: "6d76609f-349c-4575-b1a2-be232805d9cc"). InnerVolumeSpecName "kube-api-access-7m766". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:29:25.150118 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.150075    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util" (OuterVolumeSpecName: "util") pod "6d76609f-349c-4575-b1a2-be232805d9cc" (UID: "6d76609f-349c-4575-b1a2-be232805d9cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:29:25.245824 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.245784    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:25.245824 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.245816    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d76609f-349c-4575-b1a2-be232805d9cc-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:25.245824 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.245826    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m766\" (UniqueName: \"kubernetes.io/projected/6d76609f-349c-4575-b1a2-be232805d9cc-kube-api-access-7m766\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:29:25.852582 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.852550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r" event={"ID":"6d76609f-349c-4575-b1a2-be232805d9cc","Type":"ContainerDied","Data":"42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f"}
Jul 09 12:29:25.852745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.852594    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42fc144263b750d5171e640927527cb296027f6db2f036a1c6f67977c04e8d4f"
Jul 09 12:29:25.852745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:25.852595    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af54h9r"
Jul 09 12:29:33.945988 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.945950    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"]
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946288    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="extract"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946298    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="extract"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946309    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="pull"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946315    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="pull"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946324    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="util"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946328    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="util"
Jul 09 12:29:33.946439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.946388    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d76609f-349c-4575-b1a2-be232805d9cc" containerName="extract"
Jul 09 12:29:33.949773 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.949753    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:33.954738 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.954718    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 12:29:33.954870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.954854    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2gqgj\""
Jul 09 12:29:33.955433 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.955418    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 12:29:33.955679 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.955665    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 12:29:33.959258 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:33.959241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 12:29:34.016536 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.016482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.016694 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.016553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-manifests\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.016694 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.016632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfgbq\" (UniqueName: \"kubernetes.io/projected/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-kube-api-access-pfgbq\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.016694 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.016664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.016800 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.016742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-tmp\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.102983 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.102946    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"]
Jul 09 12:29:34.117661 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.117635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-manifests\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.117796 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.117685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfgbq\" (UniqueName: \"kubernetes.io/projected/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-kube-api-access-pfgbq\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.117796 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.117724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.117877 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.117860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-tmp\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.117947 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.117932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.118093 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.118074    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-manifests\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.120169 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.120142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-tmp\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.120278 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.120211    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.120278 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.120245    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.135354 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.135325    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfgbq\" (UniqueName: \"kubernetes.io/projected/7f8eb546-2f1a-4285-9cbf-2568ac57e2cf-kube-api-access-pfgbq\") pod \"opendatahub-operator-controller-manager-578cb9c586-f49dj\" (UID: \"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf\") " pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.259711 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.259684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:34.417397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.417370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"]
Jul 09 12:29:34.419622 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:34.419595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8eb546_2f1a_4285_9cbf_2568ac57e2cf.slice/crio-8617e31ac3d7326fa290e4501121eb0f2164c96434dcc019be2e8ca461b4d75d WatchSource:0}: Error finding container 8617e31ac3d7326fa290e4501121eb0f2164c96434dcc019be2e8ca461b4d75d: Status 404 returned error can't find the container with id 8617e31ac3d7326fa290e4501121eb0f2164c96434dcc019be2e8ca461b4d75d
Jul 09 12:29:34.897697 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:34.897656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj" event={"ID":"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf","Type":"ContainerStarted","Data":"8617e31ac3d7326fa290e4501121eb0f2164c96434dcc019be2e8ca461b4d75d"}
Jul 09 12:29:37.916161 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:37.916068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj" event={"ID":"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf","Type":"ContainerStarted","Data":"39cefd12f4e0b93428043407130f927eeda056dbff238ccd4affa98ab4da481a"}
Jul 09 12:29:38.922254 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:38.922147    2573 generic.go:356] "Generic (PLEG): container finished" podID="7f8eb546-2f1a-4285-9cbf-2568ac57e2cf" containerID="39cefd12f4e0b93428043407130f927eeda056dbff238ccd4affa98ab4da481a" exitCode=0
Jul 09 12:29:38.922640 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:38.922242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj" event={"ID":"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf","Type":"ContainerDied","Data":"39cefd12f4e0b93428043407130f927eeda056dbff238ccd4affa98ab4da481a"}
Jul 09 12:29:39.927977 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:39.927942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj" event={"ID":"7f8eb546-2f1a-4285-9cbf-2568ac57e2cf","Type":"ContainerStarted","Data":"29f051bebf58af856a3de245a2dcc9e44eacc234a0c8582439939756abe4db61"}
Jul 09 12:29:39.928376 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:39.928039    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:39.985934 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:39.985882    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj" podStartSLOduration=2.445551331 podStartE2EDuration="6.985866145s" totalImagesPullingTime="3.490441096s" totalInitContainerRuntime="1.049873718s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:29:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:29:39.985454149 +0000 UTC m=+295.976585316" watchObservedRunningTime="2026-07-09 12:29:39.985866145 +0000 UTC m=+295.976997295"
Jul 09 12:29:44.390452 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:44.390424    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:29:44.392642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:44.392618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:29:44.393796 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:44.393771    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:29:44.396065 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:44.396044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:29:44.400808 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:44.400784    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 12:29:50.935000 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:50.934969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-578cb9c586-f49dj"
Jul 09 12:29:51.317290 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.317259    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"]
Jul 09 12:29:51.319624 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.319606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.324931 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.324900    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 12:29:51.325069 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.325041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 12:29:51.325242 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.325222    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 12:29:51.325338 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.325276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 12:29:51.325432 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.325412    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 12:29:51.325524 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.325477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jnhdp\""
Jul 09 12:29:51.350064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.350040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"]
Jul 09 12:29:51.379487 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.379461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.379618 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.379498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49x6\" (UniqueName: \"kubernetes.io/projected/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-kube-api-access-m49x6\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.379618 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.379575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-metrics-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.379701 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.379628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-manager-config\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.480578 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.480553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-manager-config\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.480713 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.480596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.480713 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.480622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49x6\" (UniqueName: \"kubernetes.io/projected/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-kube-api-access-m49x6\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.480713 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.480656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-metrics-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.481187 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.481161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-manager-config\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.483034 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.483016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.483109 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.483050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-metrics-cert\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.494326 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.494299    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49x6\" (UniqueName: \"kubernetes.io/projected/805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5-kube-api-access-m49x6\") pod \"lws-controller-manager-5467b45f76-zfct9\" (UID: \"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5\") " pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.629312 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.629213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:51.786597 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.786574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"]
Jul 09 12:29:51.788729 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:51.788685    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805d420d_4017_4f7c_9ad4_b5fbaa2c6ac5.slice/crio-1cc974cf2884b6d9950aa47c913ab05505f74f7023767b082187cbdabd33e5fb WatchSource:0}: Error finding container 1cc974cf2884b6d9950aa47c913ab05505f74f7023767b082187cbdabd33e5fb: Status 404 returned error can't find the container with id 1cc974cf2884b6d9950aa47c913ab05505f74f7023767b082187cbdabd33e5fb
Jul 09 12:29:51.790822 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.790804    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 12:29:51.983473 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:51.983434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9" event={"ID":"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5","Type":"ContainerStarted","Data":"1cc974cf2884b6d9950aa47c913ab05505f74f7023767b082187cbdabd33e5fb"}
Jul 09 12:29:53.994677 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:53.994640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9" event={"ID":"805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5","Type":"ContainerStarted","Data":"a933bbf045bce0032ee9eff6921aa8c4f4ed312a41c06e78cf3a817a50e58b94"}
Jul 09 12:29:53.995041 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:53.994765    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:29:54.038224 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:54.038176    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9" podStartSLOduration=1.5648952760000001 podStartE2EDuration="3.038161326s" totalImagesPullingTime="1.47326605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:29:54.03729308 +0000 UTC m=+310.028424230" watchObservedRunningTime="2026-07-09 12:29:54.038161326 +0000 UTC m=+310.029292530"
Jul 09 12:29:55.996673 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:55.996634    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7776979d9-867vl"]
Jul 09 12:29:55.999974 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:55.999945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.012429 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.011954    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 12:29:56.040383 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.040354    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 12:29:56.040561 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.040430    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 12:29:56.040561 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.040353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ltk2m\""
Jul 09 12:29:56.071181 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.071158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7776979d9-867vl"]
Jul 09 12:29:56.086837 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.086815    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 12:29:56.126603 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.126571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tls-certs\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.126730 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.126702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfpxf\" (UniqueName: \"kubernetes.io/projected/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-kube-api-access-mfpxf\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.126793 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.126750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tmp\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.228153 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.228117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tmp\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.228307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.228170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tls-certs\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.228307 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.228235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfpxf\" (UniqueName: \"kubernetes.io/projected/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-kube-api-access-mfpxf\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.230368 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.230344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tmp\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.230593 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.230575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-tls-certs\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.281048 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.280986    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfpxf\" (UniqueName: \"kubernetes.io/projected/adb1e00f-bfe3-43f5-a883-5e21a99cab6f-kube-api-access-mfpxf\") pod \"kube-auth-proxy-7776979d9-867vl\" (UID: \"adb1e00f-bfe3-43f5-a883-5e21a99cab6f\") " pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.319037 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.319014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl"
Jul 09 12:29:56.546411 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:56.546327    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7776979d9-867vl"]
Jul 09 12:29:56.550417 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:29:56.550388    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb1e00f_bfe3_43f5_a883_5e21a99cab6f.slice/crio-0d7a741f24e13d79086dc633dff797da08181de623c26f953c68894e495ff9ef WatchSource:0}: Error finding container 0d7a741f24e13d79086dc633dff797da08181de623c26f953c68894e495ff9ef: Status 404 returned error can't find the container with id 0d7a741f24e13d79086dc633dff797da08181de623c26f953c68894e495ff9ef
Jul 09 12:29:57.014489 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:29:57.014453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl" event={"ID":"adb1e00f-bfe3-43f5-a883-5e21a99cab6f","Type":"ContainerStarted","Data":"0d7a741f24e13d79086dc633dff797da08181de623c26f953c68894e495ff9ef"}
Jul 09 12:30:00.031182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:30:00.031090    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl" event={"ID":"adb1e00f-bfe3-43f5-a883-5e21a99cab6f","Type":"ContainerStarted","Data":"f0336fbeb4e052a3a59edcce7584dccb5bfdb616e7e266e46e2365851ddd204a"}
Jul 09 12:30:00.092409 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:30:00.092352    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7776979d9-867vl" podStartSLOduration=1.9129661599999999 podStartE2EDuration="5.092337711s" totalImagesPullingTime="3.179371551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:30:00.091386264 +0000 UTC m=+316.082517415" watchObservedRunningTime="2026-07-09 12:30:00.092337711 +0000 UTC m=+316.083468861"
Jul 09 12:30:05.001956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:30:05.001923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5467b45f76-zfct9"
Jul 09 12:31:09.761488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.761452    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"]
Jul 09 12:31:09.764897 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.764879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.767681 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.767661    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 12:31:09.768818 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.768803    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 12:31:09.768879 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.768827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xjkhj\""
Jul 09 12:31:09.773281 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.773262    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"]
Jul 09 12:31:09.876255 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.876223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.876255 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.876258    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4g66\" (UniqueName: \"kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.876439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.876346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.977666 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.977637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.977805 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.977692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.977805 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.977718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4g66\" (UniqueName: \"kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.978032 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.978001    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.978076 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.978058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:09.988121 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:09.988098    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4g66\" (UniqueName: \"kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:10.074844 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.074778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:10.204165 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.204142    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"]
Jul 09 12:31:10.205962 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:31:10.205931    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc6ec06_42d2_479f_a894_3811118e898c.slice/crio-f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575 WatchSource:0}: Error finding container f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575: Status 404 returned error can't find the container with id f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575
Jul 09 12:31:10.351106 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.351029    2573 generic.go:356] "Generic (PLEG): container finished" podID="afc6ec06-42d2-479f-a894-3811118e898c" containerID="99d4034e03f3b2049b80498a0271e4d0449cda3519593f9258409e38408de650" exitCode=0
Jul 09 12:31:10.351251 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.351142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b" event={"ID":"afc6ec06-42d2-479f-a894-3811118e898c","Type":"ContainerDied","Data":"99d4034e03f3b2049b80498a0271e4d0449cda3519593f9258409e38408de650"}
Jul 09 12:31:10.351251 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.351239    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b" event={"ID":"afc6ec06-42d2-479f-a894-3811118e898c","Type":"ContainerStarted","Data":"f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575"}
Jul 09 12:31:10.361983 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.361956    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"]
Jul 09 12:31:10.365705 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.365688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.376018 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.375995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"]
Jul 09 12:31:10.483054 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.483017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.483202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.483061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvk67\" (UniqueName: \"kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.483256 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.483204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.583925 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.583885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.584068 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.583931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.584068 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.583953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvk67\" (UniqueName: \"kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.584269 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.584236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.584311 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.584268    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.594256 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.594233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvk67\" (UniqueName: \"kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.678381 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.678293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:10.814165 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:10.814140    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"]
Jul 09 12:31:10.815897 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:31:10.815869    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f9430c_991b_475f_9fda_f1cf72403611.slice/crio-eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42 WatchSource:0}: Error finding container eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42: Status 404 returned error can't find the container with id eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42
Jul 09 12:31:11.005060 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.005036    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"]
Jul 09 12:31:11.008367 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.008350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.022475 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.022451    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"]
Jul 09 12:31:11.087645 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.087624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.087768 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.087664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.087768 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.087723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8wm\" (UniqueName: \"kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.188629 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.188598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.188762 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.188666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.188840 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.188756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8wm\" (UniqueName: \"kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.189040 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.189008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.189135 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.189037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.202420 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.202392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8wm\" (UniqueName: \"kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.316913 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.316895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:11.358414 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.358384    2573 generic.go:356] "Generic (PLEG): container finished" podID="02f9430c-991b-475f-9fda-f1cf72403611" containerID="18f6ccd515cd7ba834613f26deabeb8e3baab4e903f71a0c2afaa12c96187267" exitCode=0
Jul 09 12:31:11.358547 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.358473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs" event={"ID":"02f9430c-991b-475f-9fda-f1cf72403611","Type":"ContainerDied","Data":"18f6ccd515cd7ba834613f26deabeb8e3baab4e903f71a0c2afaa12c96187267"}
Jul 09 12:31:11.358609 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.358550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs" event={"ID":"02f9430c-991b-475f-9fda-f1cf72403611","Type":"ContainerStarted","Data":"eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42"}
Jul 09 12:31:11.360571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.360550    2573 generic.go:356] "Generic (PLEG): container finished" podID="afc6ec06-42d2-479f-a894-3811118e898c" containerID="feb4920a18d29a95cb6686c108bade715eba91277dedaa356d3ad7a932dae87a" exitCode=0
Jul 09 12:31:11.360683 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.360634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b" event={"ID":"afc6ec06-42d2-479f-a894-3811118e898c","Type":"ContainerDied","Data":"feb4920a18d29a95cb6686c108bade715eba91277dedaa356d3ad7a932dae87a"}
Jul 09 12:31:11.468752 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.468725    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"]
Jul 09 12:31:11.470218 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:31:11.470190    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb4244c_d474_480d_bdcb_707747d96209.slice/crio-fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7 WatchSource:0}: Error finding container fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7: Status 404 returned error can't find the container with id fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7
Jul 09 12:31:11.592427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.592401    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"]
Jul 09 12:31:11.596064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.596049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.604850 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.604826    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"]
Jul 09 12:31:11.695013 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.694985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.695141 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.695045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9x4\" (UniqueName: \"kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.695141 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.695065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.796064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.795987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.796064 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.796047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9x4\" (UniqueName: \"kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.796234 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.796077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.796451 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.796431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.796487 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.796445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.806385 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.806363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9x4\" (UniqueName: \"kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:11.960411 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:11.960378    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:12.196047 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.196022    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"]
Jul 09 12:31:12.197674 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:31:12.197645    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aef0400_0af4_4012_b023_137febcdf604.slice/crio-0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a WatchSource:0}: Error finding container 0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a: Status 404 returned error can't find the container with id 0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a
Jul 09 12:31:12.367498 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.367427    2573 generic.go:356] "Generic (PLEG): container finished" podID="02f9430c-991b-475f-9fda-f1cf72403611" containerID="2abe231f1fa4a7c94fa3ddae3f3a5019d3ad7a5215fa6100dd38ef456468f986" exitCode=0
Jul 09 12:31:12.367652 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.367533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs" event={"ID":"02f9430c-991b-475f-9fda-f1cf72403611","Type":"ContainerDied","Data":"2abe231f1fa4a7c94fa3ddae3f3a5019d3ad7a5215fa6100dd38ef456468f986"}
Jul 09 12:31:12.369128 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.369095    2573 generic.go:356] "Generic (PLEG): container finished" podID="ccb4244c-d474-480d-bdcb-707747d96209" containerID="0a6eb3b705ef340b7f13ab9fe358d7785a840dc602dbc9695e8170b7f00d0975" exitCode=0
Jul 09 12:31:12.369203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.369127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n" event={"ID":"ccb4244c-d474-480d-bdcb-707747d96209","Type":"ContainerDied","Data":"0a6eb3b705ef340b7f13ab9fe358d7785a840dc602dbc9695e8170b7f00d0975"}
Jul 09 12:31:12.369203 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.369182    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n" event={"ID":"ccb4244c-d474-480d-bdcb-707747d96209","Type":"ContainerStarted","Data":"fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7"}
Jul 09 12:31:12.371237 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.371215    2573 generic.go:356] "Generic (PLEG): container finished" podID="afc6ec06-42d2-479f-a894-3811118e898c" containerID="88671a21281255d86497d8dde6c9e0d03dd4812ba2e7acc931c81b3de6e99818" exitCode=0
Jul 09 12:31:12.371348 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.371299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b" event={"ID":"afc6ec06-42d2-479f-a894-3811118e898c","Type":"ContainerDied","Data":"88671a21281255d86497d8dde6c9e0d03dd4812ba2e7acc931c81b3de6e99818"}
Jul 09 12:31:12.379571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.373490    2573 generic.go:356] "Generic (PLEG): container finished" podID="1aef0400-0af4-4012-b023-137febcdf604" containerID="920d5d08eecf1b4f3e951116981d7d1c61e92426cc8231c83464fac0221f6b72" exitCode=0
Jul 09 12:31:12.379571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.373601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w" event={"ID":"1aef0400-0af4-4012-b023-137febcdf604","Type":"ContainerDied","Data":"920d5d08eecf1b4f3e951116981d7d1c61e92426cc8231c83464fac0221f6b72"}
Jul 09 12:31:12.379571 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:12.373666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w" event={"ID":"1aef0400-0af4-4012-b023-137febcdf604","Type":"ContainerStarted","Data":"0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a"}
Jul 09 12:31:13.380611 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.380537    2573 generic.go:356] "Generic (PLEG): container finished" podID="02f9430c-991b-475f-9fda-f1cf72403611" containerID="32e735963344953b03440601e2747e55e954ea45c19e3a3ebe707f41fd5ac77d" exitCode=0
Jul 09 12:31:13.380955 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.380625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs" event={"ID":"02f9430c-991b-475f-9fda-f1cf72403611","Type":"ContainerDied","Data":"32e735963344953b03440601e2747e55e954ea45c19e3a3ebe707f41fd5ac77d"}
Jul 09 12:31:13.382591 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.382563    2573 generic.go:356] "Generic (PLEG): container finished" podID="ccb4244c-d474-480d-bdcb-707747d96209" containerID="db749a5b4c12732d8321a00f9000c991a495f536449cd55fa85ea40dd42d5636" exitCode=0
Jul 09 12:31:13.382716 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.382643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n" event={"ID":"ccb4244c-d474-480d-bdcb-707747d96209","Type":"ContainerDied","Data":"db749a5b4c12732d8321a00f9000c991a495f536449cd55fa85ea40dd42d5636"}
Jul 09 12:31:13.558215 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.558187    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:13.612292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.612272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle\") pod \"afc6ec06-42d2-479f-a894-3811118e898c\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") "
Jul 09 12:31:13.612389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.612327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util\") pod \"afc6ec06-42d2-479f-a894-3811118e898c\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") "
Jul 09 12:31:13.612389 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.612353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4g66\" (UniqueName: \"kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66\") pod \"afc6ec06-42d2-479f-a894-3811118e898c\" (UID: \"afc6ec06-42d2-479f-a894-3811118e898c\") "
Jul 09 12:31:13.613014 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.612988    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle" (OuterVolumeSpecName: "bundle") pod "afc6ec06-42d2-479f-a894-3811118e898c" (UID: "afc6ec06-42d2-479f-a894-3811118e898c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:13.614842 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.614816    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66" (OuterVolumeSpecName: "kube-api-access-f4g66") pod "afc6ec06-42d2-479f-a894-3811118e898c" (UID: "afc6ec06-42d2-479f-a894-3811118e898c"). InnerVolumeSpecName "kube-api-access-f4g66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:31:13.618231 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.618212    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util" (OuterVolumeSpecName: "util") pod "afc6ec06-42d2-479f-a894-3811118e898c" (UID: "afc6ec06-42d2-479f-a894-3811118e898c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:13.713432 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.713406    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:13.713432 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.713431    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc6ec06-42d2-479f-a894-3811118e898c-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:13.713585 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:13.713440    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4g66\" (UniqueName: \"kubernetes.io/projected/afc6ec06-42d2-479f-a894-3811118e898c-kube-api-access-f4g66\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:14.389153 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.389072    2573 generic.go:356] "Generic (PLEG): container finished" podID="1aef0400-0af4-4012-b023-137febcdf604" containerID="9c46735b361dfd8a98c36b661a61a46b3c236fdc26ab67b79e550cb92ffdd8fb" exitCode=0
Jul 09 12:31:14.389563 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.389151    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w" event={"ID":"1aef0400-0af4-4012-b023-137febcdf604","Type":"ContainerDied","Data":"9c46735b361dfd8a98c36b661a61a46b3c236fdc26ab67b79e550cb92ffdd8fb"}
Jul 09 12:31:14.391419 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.391399    2573 generic.go:356] "Generic (PLEG): container finished" podID="ccb4244c-d474-480d-bdcb-707747d96209" containerID="9d608d5dc26e83b8ba8f4962c940d180f4e93278ffd7cfd02a5b478038cc28b0" exitCode=0
Jul 09 12:31:14.391522 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.391484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n" event={"ID":"ccb4244c-d474-480d-bdcb-707747d96209","Type":"ContainerDied","Data":"9d608d5dc26e83b8ba8f4962c940d180f4e93278ffd7cfd02a5b478038cc28b0"}
Jul 09 12:31:14.393312 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.393286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b" event={"ID":"afc6ec06-42d2-479f-a894-3811118e898c","Type":"ContainerDied","Data":"f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575"}
Jul 09 12:31:14.393404 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.393322    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b"
Jul 09 12:31:14.393404 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.393330    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f441535d3de12a02e38b3312c3ac46ddcdeeaea03edeac5856ed464212131575"
Jul 09 12:31:14.529111 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.529087    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:14.620659 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.620629    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle\") pod \"02f9430c-991b-475f-9fda-f1cf72403611\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") "
Jul 09 12:31:14.620817 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.620740    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util\") pod \"02f9430c-991b-475f-9fda-f1cf72403611\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") "
Jul 09 12:31:14.620817 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.620776    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvk67\" (UniqueName: \"kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67\") pod \"02f9430c-991b-475f-9fda-f1cf72403611\" (UID: \"02f9430c-991b-475f-9fda-f1cf72403611\") "
Jul 09 12:31:14.621220 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.621194    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle" (OuterVolumeSpecName: "bundle") pod "02f9430c-991b-475f-9fda-f1cf72403611" (UID: "02f9430c-991b-475f-9fda-f1cf72403611"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:14.622989 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.622956    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67" (OuterVolumeSpecName: "kube-api-access-cvk67") pod "02f9430c-991b-475f-9fda-f1cf72403611" (UID: "02f9430c-991b-475f-9fda-f1cf72403611"). InnerVolumeSpecName "kube-api-access-cvk67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:31:14.626633 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.626610    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util" (OuterVolumeSpecName: "util") pod "02f9430c-991b-475f-9fda-f1cf72403611" (UID: "02f9430c-991b-475f-9fda-f1cf72403611"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:14.721529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.721442    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:14.721529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.721469    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvk67\" (UniqueName: \"kubernetes.io/projected/02f9430c-991b-475f-9fda-f1cf72403611-kube-api-access-cvk67\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:14.721529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:14.721478    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02f9430c-991b-475f-9fda-f1cf72403611-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:15.399648 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.399575    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs"
Jul 09 12:31:15.399648 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.399604    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs" event={"ID":"02f9430c-991b-475f-9fda-f1cf72403611","Type":"ContainerDied","Data":"eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42"}
Jul 09 12:31:15.400160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.399686    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb84cf0c553c2b1855fc5dcac62c17cc4842f403072e2be86fb8944fa3e05f42"
Jul 09 12:31:15.401743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.401711    2573 generic.go:356] "Generic (PLEG): container finished" podID="1aef0400-0af4-4012-b023-137febcdf604" containerID="0b0865cabca87141b40e103e1eb83a4c66f80c0c2f89e7c49e30847ce646064a" exitCode=0
Jul 09 12:31:15.401868 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.401779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w" event={"ID":"1aef0400-0af4-4012-b023-137febcdf604","Type":"ContainerDied","Data":"0b0865cabca87141b40e103e1eb83a4c66f80c0c2f89e7c49e30847ce646064a"}
Jul 09 12:31:15.534726 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.534702    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:15.628131 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.628105    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util\") pod \"ccb4244c-d474-480d-bdcb-707747d96209\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") "
Jul 09 12:31:15.628306 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.628159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh8wm\" (UniqueName: \"kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm\") pod \"ccb4244c-d474-480d-bdcb-707747d96209\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") "
Jul 09 12:31:15.628306 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.628180    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle\") pod \"ccb4244c-d474-480d-bdcb-707747d96209\" (UID: \"ccb4244c-d474-480d-bdcb-707747d96209\") "
Jul 09 12:31:15.628774 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.628735    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle" (OuterVolumeSpecName: "bundle") pod "ccb4244c-d474-480d-bdcb-707747d96209" (UID: "ccb4244c-d474-480d-bdcb-707747d96209"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:15.630285 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.630254    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm" (OuterVolumeSpecName: "kube-api-access-gh8wm") pod "ccb4244c-d474-480d-bdcb-707747d96209" (UID: "ccb4244c-d474-480d-bdcb-707747d96209"). InnerVolumeSpecName "kube-api-access-gh8wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:31:15.633131 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.633112    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util" (OuterVolumeSpecName: "util") pod "ccb4244c-d474-480d-bdcb-707747d96209" (UID: "ccb4244c-d474-480d-bdcb-707747d96209"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:15.728900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.728864    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh8wm\" (UniqueName: \"kubernetes.io/projected/ccb4244c-d474-480d-bdcb-707747d96209-kube-api-access-gh8wm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:15.728900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.728897    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:15.729081 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:15.728912    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccb4244c-d474-480d-bdcb-707747d96209-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:16.408291 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.408265    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n"
Jul 09 12:31:16.408675 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.408283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n" event={"ID":"ccb4244c-d474-480d-bdcb-707747d96209","Type":"ContainerDied","Data":"fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7"}
Jul 09 12:31:16.408675 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.408327    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbf9500f05fa2a84fbabf9abafc612c5ad233faf572037696380c13ccbe770d7"
Jul 09 12:31:16.533930 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.533907    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:16.637219 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.637189    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util\") pod \"1aef0400-0af4-4012-b023-137febcdf604\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") "
Jul 09 12:31:16.637344 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.637262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle\") pod \"1aef0400-0af4-4012-b023-137febcdf604\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") "
Jul 09 12:31:16.637344 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.637324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd9x4\" (UniqueName: \"kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4\") pod \"1aef0400-0af4-4012-b023-137febcdf604\" (UID: \"1aef0400-0af4-4012-b023-137febcdf604\") "
Jul 09 12:31:16.637699 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.637668    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle" (OuterVolumeSpecName: "bundle") pod "1aef0400-0af4-4012-b023-137febcdf604" (UID: "1aef0400-0af4-4012-b023-137febcdf604"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:16.639218 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.639198    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4" (OuterVolumeSpecName: "kube-api-access-bd9x4") pod "1aef0400-0af4-4012-b023-137febcdf604" (UID: "1aef0400-0af4-4012-b023-137febcdf604"). InnerVolumeSpecName "kube-api-access-bd9x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:31:16.644059 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.644037    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util" (OuterVolumeSpecName: "util") pod "1aef0400-0af4-4012-b023-137febcdf604" (UID: "1aef0400-0af4-4012-b023-137febcdf604"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:31:16.738836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.738802    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:16.738836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.738831    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd9x4\" (UniqueName: \"kubernetes.io/projected/1aef0400-0af4-4012-b023-137febcdf604-kube-api-access-bd9x4\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:16.738836 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:16.738842    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1aef0400-0af4-4012-b023-137febcdf604-util\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:31:17.415816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:17.415786    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w"
Jul 09 12:31:17.415816 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:17.415801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w" event={"ID":"1aef0400-0af4-4012-b023-137febcdf604","Type":"ContainerDied","Data":"0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a"}
Jul 09 12:31:17.416234 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:17.415850    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0947f61cd0d71e7ecc5d0a9907791b07aa16d465369ad2860608f09657d2940a"
Jul 09 12:31:35.007492 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:35.007454    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:31:40.222934 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.222901    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"]
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223275    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223290    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223300    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223306    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223314    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223319    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223325    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223330    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223338    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223344    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223351    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223356    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223363    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223368    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223374    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223379    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="pull"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223385    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223391    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223400    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223405    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="extract"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223411    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="util"
Jul 09 12:31:40.223405 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223415    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="util"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223425    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="pull"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223430    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="pull"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223482    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccb4244c-d474-480d-bdcb-707747d96209" containerName="extract"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223492    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f9430c-991b-475f-9fda-f1cf72403611" containerName="extract"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223498    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc6ec06-42d2-479f-a894-3811118e898c" containerName="extract"
Jul 09 12:31:40.224202 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.223518    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aef0400-0af4-4012-b023-137febcdf604" containerName="extract"
Jul 09 12:31:40.226538 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.226500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.229148 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.229123    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 12:31:40.229299 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.229275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 12:31:40.229299 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.229275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 12:31:40.229398 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.229275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 12:31:40.230292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.230276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xjkhj\""
Jul 09 12:31:40.238053 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.238033    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"]
Jul 09 12:31:40.248786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.248762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkc7\" (UniqueName: \"kubernetes.io/projected/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-kube-api-access-zbkc7\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.248910 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.248822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.248974 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.248918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.349877 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.349838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkc7\" (UniqueName: \"kubernetes.io/projected/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-kube-api-access-zbkc7\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.350061 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.349890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.350061 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.349941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.350061 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:31:40.350042    2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 12:31:40.350188 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:31:40.350109    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert podName:49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd nodeName:}" failed. No retries permitted until 2026-07-09 12:31:40.850084938 +0000 UTC m=+416.841216066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4hx7x" (UID: "49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd") : secret "plugin-serving-cert" not found
Jul 09 12:31:40.350620 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.350601    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.358747 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.358712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkc7\" (UniqueName: \"kubernetes.io/projected/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-kube-api-access-zbkc7\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.854819 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.854785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:40.857159 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:40.857142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4hx7x\" (UID: \"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:41.135376 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:41.135304    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"
Jul 09 12:31:41.268260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:41.268236    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x"]
Jul 09 12:31:41.269988 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:31:41.269960    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b78c8b_2dce_4bcf_9ca1_2db6411a0dfd.slice/crio-6d06dfcfcb16b28ad6cdf65fc14b6944d46f08b737aa1cefecaa7779c990ff0e WatchSource:0}: Error finding container 6d06dfcfcb16b28ad6cdf65fc14b6944d46f08b737aa1cefecaa7779c990ff0e: Status 404 returned error can't find the container with id 6d06dfcfcb16b28ad6cdf65fc14b6944d46f08b737aa1cefecaa7779c990ff0e
Jul 09 12:31:41.544811 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:41.544776    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x" event={"ID":"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd","Type":"ContainerStarted","Data":"6d06dfcfcb16b28ad6cdf65fc14b6944d46f08b737aa1cefecaa7779c990ff0e"}
Jul 09 12:31:52.633215 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.633185    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:31:52.653667 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.653539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.656150 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.656119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:31:52.657523 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.657489    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m247t\""
Jul 09 12:31:52.769725 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.769689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.769725 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.769739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m464\" (UniqueName: \"kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.870362 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.870318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.870568 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.870386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m464\" (UniqueName: \"kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.870731 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.870712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.881045 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.881014    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m464\" (UniqueName: \"kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464\") pod \"kuadrant-operator-controller-manager-86878c769f-f4v2m\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:31:52.965970 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:31:52.965880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:32:00.029358 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:00.029281    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-568f6cb58-hwzp7" podUID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" containerName="console" containerID="cri-o://4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef" gracePeriod=15
Jul 09 12:32:06.928957 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:06.928929    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:32:06.940143 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:06.940114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:32:06.942070 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:32:06.942018    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7756c6cc_48d6_4337_b895_d727d1d72e10.slice/crio-f0bd3134190e4366b442c4a6a52add4825d9c2ed343ef22c87f064d4a8475c80 WatchSource:0}: Error finding container f0bd3134190e4366b442c4a6a52add4825d9c2ed343ef22c87f064d4a8475c80: Status 404 returned error can't find the container with id f0bd3134190e4366b442c4a6a52add4825d9c2ed343ef22c87f064d4a8475c80
Jul 09 12:32:07.012123 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012123 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012130    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012217    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012275    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012296    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012342    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz9tr\" (UniqueName: \"kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr\") pod \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\" (UID: \"645ab43d-0f63-4aa2-b653-d1baf39b2dce\") "
Jul 09 12:32:07.012678 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012583    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:32:07.012734 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012689    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-trusted-ca-bundle\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.012773 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012726    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca" (OuterVolumeSpecName: "service-ca") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:32:07.012838 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012774    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config" (OuterVolumeSpecName: "console-config") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:32:07.012890 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.012874    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 12:32:07.014683 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.014656    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:32:07.014683 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.014679    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:32:07.014831 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.014679    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr" (OuterVolumeSpecName: "kube-api-access-fz9tr") pod "645ab43d-0f63-4aa2-b653-d1baf39b2dce" (UID: "645ab43d-0f63-4aa2-b653-d1baf39b2dce"). InnerVolumeSpecName "kube-api-access-fz9tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114090    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114123    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-oauth-config\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114137    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz9tr\" (UniqueName: \"kubernetes.io/projected/645ab43d-0f63-4aa2-b653-d1baf39b2dce-kube-api-access-fz9tr\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114150    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-oauth-serving-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114162    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/645ab43d-0f63-4aa2-b653-d1baf39b2dce-service-ca\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.114182 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.114173    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/645ab43d-0f63-4aa2-b653-d1baf39b2dce-console-serving-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:32:07.699693 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.699654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x" event={"ID":"49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd","Type":"ContainerStarted","Data":"1952877310cdbb813cc0dc12af449edc589b667d3c5435e2d86c97f002f38475"}
Jul 09 12:32:07.701095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.701062    2573 generic.go:356] "Generic (PLEG): container finished" podID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" containerID="4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef" exitCode=0
Jul 09 12:32:07.701211 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.701149    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f6cb58-hwzp7"
Jul 09 12:32:07.701211 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.701184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f6cb58-hwzp7" event={"ID":"645ab43d-0f63-4aa2-b653-d1baf39b2dce","Type":"ContainerDied","Data":"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"}
Jul 09 12:32:07.701305 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.701254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f6cb58-hwzp7" event={"ID":"645ab43d-0f63-4aa2-b653-d1baf39b2dce","Type":"ContainerDied","Data":"72c62a8e5f0e7f6bf6960ca64806496c1337202fca3ff65cee86b04da2c92ba5"}
Jul 09 12:32:07.701305 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.701273    2573 scope.go:117] "RemoveContainer" containerID="4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"
Jul 09 12:32:07.702558 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.702533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" event={"ID":"7756c6cc-48d6-4337-b895-d727d1d72e10","Type":"ContainerStarted","Data":"f0bd3134190e4366b442c4a6a52add4825d9c2ed343ef22c87f064d4a8475c80"}
Jul 09 12:32:07.720745 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.720705    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4hx7x" podStartSLOduration=2.119553591 podStartE2EDuration="27.72069242s" totalImagesPullingTime="25.601138829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:32:07.717472318 +0000 UTC m=+443.708603471" watchObservedRunningTime="2026-07-09 12:32:07.72069242 +0000 UTC m=+443.711823569"
Jul 09 12:32:07.735531 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.735485    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:32:07.738739 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.738711    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568f6cb58-hwzp7"]
Jul 09 12:32:07.743786 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.743760    2573 scope.go:117] "RemoveContainer" containerID="4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"
Jul 09 12:32:07.744097 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:32:07.744069    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef\": container with ID starting with 4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef not found: ID does not exist" containerID="4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"
Jul 09 12:32:07.744197 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:07.744105    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef"} err="failed to get container status \"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef\": rpc error: code = NotFound desc = could not find container \"4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef\": container with ID starting with 4e4c73b91dfc7214e2ac15c5b8263d41831e9ffe82591c96dca3ec6be9bfa2ef not found: ID does not exist"
Jul 09 12:32:08.566217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:08.566182    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" path="/var/lib/kubelet/pods/645ab43d-0f63-4aa2-b653-d1baf39b2dce/volumes"
Jul 09 12:32:12.732090 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:12.732055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" event={"ID":"7756c6cc-48d6-4337-b895-d727d1d72e10","Type":"ContainerStarted","Data":"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"}
Jul 09 12:32:12.732455 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:12.732123    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:32:12.757055 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:12.756986    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" podStartSLOduration=15.982624067 podStartE2EDuration="20.756967104s" totalImagesPullingTime="4.774343037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:32:12.755788404 +0000 UTC m=+448.746919556" watchObservedRunningTime="2026-07-09 12:32:12.756967104 +0000 UTC m=+448.748098254"
Jul 09 12:32:23.741450 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:23.741416    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:32:43.626290 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.626252    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:32:43.626721 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.626619    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" containerName="console"
Jul 09 12:32:43.626721 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.626632    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" containerName="console"
Jul 09 12:32:43.626721 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.626702    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="645ab43d-0f63-4aa2-b653-d1baf39b2dce" containerName="console"
Jul 09 12:32:43.660602 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.660574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:32:43.660754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.660670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:32:43.663878 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.663855    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h55pp\""
Jul 09 12:32:43.749915 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.749879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq9jn\" (UniqueName: \"kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn\") pod \"authorino-75d556bd77-722vd\" (UID: \"9afd5010-69f5-472d-a590-4221ca5bc369\") " pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:32:43.850641 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.850604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq9jn\" (UniqueName: \"kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn\") pod \"authorino-75d556bd77-722vd\" (UID: \"9afd5010-69f5-472d-a590-4221ca5bc369\") " pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:32:43.860734 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.860706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq9jn\" (UniqueName: \"kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn\") pod \"authorino-75d556bd77-722vd\" (UID: \"9afd5010-69f5-472d-a590-4221ca5bc369\") " pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:32:43.969866 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:43.969771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:32:44.098107 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:44.098083    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:32:44.099671 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:32:44.099641    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9afd5010_69f5_472d_a590_4221ca5bc369.slice/crio-ba85c292289f252650e038e1d70cb12ca3b21bac51893f39029d6ea07f4a3f61 WatchSource:0}: Error finding container ba85c292289f252650e038e1d70cb12ca3b21bac51893f39029d6ea07f4a3f61: Status 404 returned error can't find the container with id ba85c292289f252650e038e1d70cb12ca3b21bac51893f39029d6ea07f4a3f61
Jul 09 12:32:44.896321 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:44.896283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-722vd" event={"ID":"9afd5010-69f5-472d-a590-4221ca5bc369","Type":"ContainerStarted","Data":"ba85c292289f252650e038e1d70cb12ca3b21bac51893f39029d6ea07f4a3f61"}
Jul 09 12:32:47.914568 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:47.914533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-722vd" event={"ID":"9afd5010-69f5-472d-a590-4221ca5bc369","Type":"ContainerStarted","Data":"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"}
Jul 09 12:32:47.936113 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:32:47.936067    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-722vd" podStartSLOduration=1.650663564 podStartE2EDuration="4.936051847s" totalImagesPullingTime="3.285388283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:32:47.935291515 +0000 UTC m=+483.926422685" watchObservedRunningTime="2026-07-09 12:32:47.936051847 +0000 UTC m=+483.927182997"
Jul 09 12:33:19.582552 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.582500    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:33:19.583014 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.582728    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-722vd" podUID="9afd5010-69f5-472d-a590-4221ca5bc369" containerName="authorino" containerID="cri-o://991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb" gracePeriod=30
Jul 09 12:33:19.824578 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.824542    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:33:19.865663 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.865592    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq9jn\" (UniqueName: \"kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn\") pod \"9afd5010-69f5-472d-a590-4221ca5bc369\" (UID: \"9afd5010-69f5-472d-a590-4221ca5bc369\") "
Jul 09 12:33:19.867589 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.867559    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn" (OuterVolumeSpecName: "kube-api-access-lq9jn") pod "9afd5010-69f5-472d-a590-4221ca5bc369" (UID: "9afd5010-69f5-472d-a590-4221ca5bc369"). InnerVolumeSpecName "kube-api-access-lq9jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:33:19.966821 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:19.966786    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq9jn\" (UniqueName: \"kubernetes.io/projected/9afd5010-69f5-472d-a590-4221ca5bc369-kube-api-access-lq9jn\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:33:20.076958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.076918    2573 generic.go:356] "Generic (PLEG): container finished" podID="9afd5010-69f5-472d-a590-4221ca5bc369" containerID="991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb" exitCode=0
Jul 09 12:33:20.076958 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.076964    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-722vd"
Jul 09 12:33:20.077160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.076998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-722vd" event={"ID":"9afd5010-69f5-472d-a590-4221ca5bc369","Type":"ContainerDied","Data":"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"}
Jul 09 12:33:20.077160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.077044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-722vd" event={"ID":"9afd5010-69f5-472d-a590-4221ca5bc369","Type":"ContainerDied","Data":"ba85c292289f252650e038e1d70cb12ca3b21bac51893f39029d6ea07f4a3f61"}
Jul 09 12:33:20.077160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.077063    2573 scope.go:117] "RemoveContainer" containerID="991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"
Jul 09 12:33:20.086165 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.086147    2573 scope.go:117] "RemoveContainer" containerID="991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"
Jul 09 12:33:20.086439 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:33:20.086419    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb\": container with ID starting with 991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb not found: ID does not exist" containerID="991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"
Jul 09 12:33:20.086613 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.086447    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb"} err="failed to get container status \"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb\": rpc error: code = NotFound desc = could not find container \"991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb\": container with ID starting with 991a5936a8821e8c7bdcfdbd225b8815e770bf1aefe0cfa0e4fd57e7e32bdedb not found: ID does not exist"
Jul 09 12:33:20.103183 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.103149    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:33:20.108754 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.108730    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-722vd"]
Jul 09 12:33:20.565834 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:20.565795    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9afd5010-69f5-472d-a590-4221ca5bc369" path="/var/lib/kubelet/pods/9afd5010-69f5-472d-a590-4221ca5bc369/volumes"
Jul 09 12:33:24.221696 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.221659    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:24.222245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.222206    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afd5010-69f5-472d-a590-4221ca5bc369" containerName="authorino"
Jul 09 12:33:24.222245 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.222226    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afd5010-69f5-472d-a590-4221ca5bc369" containerName="authorino"
Jul 09 12:33:24.222372 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.222321    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afd5010-69f5-472d-a590-4221ca5bc369" containerName="authorino"
Jul 09 12:33:24.225178 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.225155    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.228095 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.228070    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 12:33:24.228232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.228068    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 12:33:24.228232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.228154    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q7frb\""
Jul 09 12:33:24.238351 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.238329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:24.305429 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.305397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwlw\" (UniqueName: \"kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.305618 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.305448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.406630 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.406597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwlw\" (UniqueName: \"kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.406805 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.406646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.409048 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.409027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.414700 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.414673    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:33:24.417390 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.417368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.418724 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.418702    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwlw\" (UniqueName: \"kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw\") pod \"maas-controller-6bc44cd46-llpdx\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") " pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.433236 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.433214    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:33:24.507741 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.507692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.507741 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.507749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmmr\" (UniqueName: \"kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.535601 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.535566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:24.608347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.608316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.608476 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.608378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmmr\" (UniqueName: \"kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.610817 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.610791    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.618826 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.618789    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmmr\" (UniqueName: \"kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr\") pod \"maas-controller-6fdc6f7f5d-7wkk2\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") " pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.682938 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.682913    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:24.684480 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:33:24.684456    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f091cb_7e09_4a09_bf21_f070ca227d62.slice/crio-47b8591ff95af0c34cab02e1f7a30d9036775a96c6d7ff8e5d0694736984b6f0 WatchSource:0}: Error finding container 47b8591ff95af0c34cab02e1f7a30d9036775a96c6d7ff8e5d0694736984b6f0: Status 404 returned error can't find the container with id 47b8591ff95af0c34cab02e1f7a30d9036775a96c6d7ff8e5d0694736984b6f0
Jul 09 12:33:24.734398 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.734368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:24.873964 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:24.873938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:33:24.875307 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:33:24.875277    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1f8832_b0d6_4347_aca2_0c12e8e2fe25.slice/crio-098e84bf8a409ae8455ee9359f3e37d5c6160729ccc1d53fcf970bddf74173d3 WatchSource:0}: Error finding container 098e84bf8a409ae8455ee9359f3e37d5c6160729ccc1d53fcf970bddf74173d3: Status 404 returned error can't find the container with id 098e84bf8a409ae8455ee9359f3e37d5c6160729ccc1d53fcf970bddf74173d3
Jul 09 12:33:25.103251 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:25.103153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" event={"ID":"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25","Type":"ContainerStarted","Data":"098e84bf8a409ae8455ee9359f3e37d5c6160729ccc1d53fcf970bddf74173d3"}
Jul 09 12:33:25.104249 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:25.104219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc44cd46-llpdx" event={"ID":"78f091cb-7e09-4a09-bf21-f070ca227d62","Type":"ContainerStarted","Data":"47b8591ff95af0c34cab02e1f7a30d9036775a96c6d7ff8e5d0694736984b6f0"}
Jul 09 12:33:28.124529 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.124459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc44cd46-llpdx" event={"ID":"78f091cb-7e09-4a09-bf21-f070ca227d62","Type":"ContainerStarted","Data":"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"}
Jul 09 12:33:28.124966 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.124546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:28.126009 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.125985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" event={"ID":"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25","Type":"ContainerStarted","Data":"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"}
Jul 09 12:33:28.126127 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.126031    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:28.194068 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.194015    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc44cd46-llpdx" podStartSLOduration=1.659292948 podStartE2EDuration="4.1939998s" totalImagesPullingTime="2.534706852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:33:28.192764852 +0000 UTC m=+524.183896021" watchObservedRunningTime="2026-07-09 12:33:28.1939998 +0000 UTC m=+524.185130951"
Jul 09 12:33:28.223137 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:28.223089    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" podStartSLOduration=1.8899977460000001 podStartE2EDuration="4.223075512s" totalImagesPullingTime="2.333077766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:33:28.220662859 +0000 UTC m=+524.211794029" watchObservedRunningTime="2026-07-09 12:33:28.223075512 +0000 UTC m=+524.214206662"
Jul 09 12:33:39.138537 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.138485    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:33:39.138979 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.138582    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:39.228914 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.228882    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:39.229077 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.229046    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc44cd46-llpdx" podUID="78f091cb-7e09-4a09-bf21-f070ca227d62" containerName="manager" containerID="cri-o://ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191" gracePeriod=30
Jul 09 12:33:39.478561 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.478536    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:39.647174 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.647082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkwlw\" (UniqueName: \"kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw\") pod \"78f091cb-7e09-4a09-bf21-f070ca227d62\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") "
Jul 09 12:33:39.647174 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.647135    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert\") pod \"78f091cb-7e09-4a09-bf21-f070ca227d62\" (UID: \"78f091cb-7e09-4a09-bf21-f070ca227d62\") "
Jul 09 12:33:39.649376 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.649341    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "78f091cb-7e09-4a09-bf21-f070ca227d62" (UID: "78f091cb-7e09-4a09-bf21-f070ca227d62"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:33:39.649484 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.649382    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw" (OuterVolumeSpecName: "kube-api-access-dkwlw") pod "78f091cb-7e09-4a09-bf21-f070ca227d62" (UID: "78f091cb-7e09-4a09-bf21-f070ca227d62"). InnerVolumeSpecName "kube-api-access-dkwlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:33:39.748735 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.748698    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78f091cb-7e09-4a09-bf21-f070ca227d62-webhook-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:33:39.748735 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:39.748731    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkwlw\" (UniqueName: \"kubernetes.io/projected/78f091cb-7e09-4a09-bf21-f070ca227d62-kube-api-access-dkwlw\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:33:40.187686 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.187652    2573 generic.go:356] "Generic (PLEG): container finished" podID="78f091cb-7e09-4a09-bf21-f070ca227d62" containerID="ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191" exitCode=0
Jul 09 12:33:40.188078 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.187709    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc44cd46-llpdx"
Jul 09 12:33:40.188078 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.187738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc44cd46-llpdx" event={"ID":"78f091cb-7e09-4a09-bf21-f070ca227d62","Type":"ContainerDied","Data":"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"}
Jul 09 12:33:40.188078 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.187795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc44cd46-llpdx" event={"ID":"78f091cb-7e09-4a09-bf21-f070ca227d62","Type":"ContainerDied","Data":"47b8591ff95af0c34cab02e1f7a30d9036775a96c6d7ff8e5d0694736984b6f0"}
Jul 09 12:33:40.188078 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.187828    2573 scope.go:117] "RemoveContainer" containerID="ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"
Jul 09 12:33:40.197319 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.197303    2573 scope.go:117] "RemoveContainer" containerID="ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"
Jul 09 12:33:40.197586 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:33:40.197569    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191\": container with ID starting with ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191 not found: ID does not exist" containerID="ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"
Jul 09 12:33:40.197645 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.197594    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191"} err="failed to get container status \"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191\": rpc error: code = NotFound desc = could not find container \"ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191\": container with ID starting with ffe99c62bb56c04271f72192a00c00892ea910edd34cb19013f7312596d1c191 not found: ID does not exist"
Jul 09 12:33:40.214636 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.214607    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:40.223606 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.223579    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc44cd46-llpdx"]
Jul 09 12:33:40.566236 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:40.566202    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f091cb-7e09-4a09-bf21-f070ca227d62" path="/var/lib/kubelet/pods/78f091cb-7e09-4a09-bf21-f070ca227d62/volumes"
Jul 09 12:33:59.644984 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.644931    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-f24fs"]
Jul 09 12:33:59.645481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.645329    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f091cb-7e09-4a09-bf21-f070ca227d62" containerName="manager"
Jul 09 12:33:59.645481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.645342    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f091cb-7e09-4a09-bf21-f070ca227d62" containerName="manager"
Jul 09 12:33:59.645481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.645414    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f091cb-7e09-4a09-bf21-f070ca227d62" containerName="manager"
Jul 09 12:33:59.651138 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.651118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.654052 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.654026    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rwnk5\""
Jul 09 12:33:59.654173 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.654026    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 12:33:59.668312 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.668291    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-f24fs"]
Jul 09 12:33:59.677155 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.677134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-65vhk"]
Jul 09 12:33:59.681134 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.681118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.697945 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.697924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-65vhk"]
Jul 09 12:33:59.723079 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.723050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.723201 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.723102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w5dp\" (UniqueName: \"kubernetes.io/projected/f5bbed0d-c21b-423c-beb3-902662029af3-kube-api-access-2w5dp\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.723201 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.723159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtjx\" (UniqueName: \"kubernetes.io/projected/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-kube-api-access-wjtjx\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.723201 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.723197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5bbed0d-c21b-423c-beb3-902662029af3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.824078 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.824260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w5dp\" (UniqueName: \"kubernetes.io/projected/f5bbed0d-c21b-423c-beb3-902662029af3-kube-api-access-2w5dp\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.824260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtjx\" (UniqueName: \"kubernetes.io/projected/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-kube-api-access-wjtjx\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.824260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5bbed0d-c21b-423c-beb3-902662029af3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.824868 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824840    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.824985 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.824934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5bbed0d-c21b-423c-beb3-902662029af3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.832607 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.832587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w5dp\" (UniqueName: \"kubernetes.io/projected/f5bbed0d-c21b-423c-beb3-902662029af3-kube-api-access-2w5dp\") pod \"payload-pre-processing-7964457696-f24fs\" (UID: \"f5bbed0d-c21b-423c-beb3-902662029af3\") " pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.832694 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.832669    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtjx\" (UniqueName: \"kubernetes.io/projected/27b6b789-70fd-4dc1-8c81-4add6a6dfb2f-kube-api-access-wjtjx\") pod \"payload-processing-58f86c7798-65vhk\" (UID: \"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f\") " pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:33:59.962394 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.962305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:33:59.990359 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:33:59.990337    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:34:00.118945 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:00.118918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-f24fs"]
Jul 09 12:34:00.120699 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:34:00.120672    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bbed0d_c21b_423c_beb3_902662029af3.slice/crio-b9c36d05fceb48dde21a48a50efd95e6eeedd96b8b970082a4b88f45f9fef999 WatchSource:0}: Error finding container b9c36d05fceb48dde21a48a50efd95e6eeedd96b8b970082a4b88f45f9fef999: Status 404 returned error can't find the container with id b9c36d05fceb48dde21a48a50efd95e6eeedd96b8b970082a4b88f45f9fef999
Jul 09 12:34:00.149157 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:00.149128    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-65vhk"]
Jul 09 12:34:00.150654 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:34:00.150622    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b6b789_70fd_4dc1_8c81_4add6a6dfb2f.slice/crio-5b6209e02b311c551271f5c28a2130a60de2ed1fe401502cb436ae08c6258a41 WatchSource:0}: Error finding container 5b6209e02b311c551271f5c28a2130a60de2ed1fe401502cb436ae08c6258a41: Status 404 returned error can't find the container with id 5b6209e02b311c551271f5c28a2130a60de2ed1fe401502cb436ae08c6258a41
Jul 09 12:34:00.298987 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:00.298951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-65vhk" event={"ID":"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f","Type":"ContainerStarted","Data":"5b6209e02b311c551271f5c28a2130a60de2ed1fe401502cb436ae08c6258a41"}
Jul 09 12:34:00.300167 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:00.300138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs" event={"ID":"f5bbed0d-c21b-423c-beb3-902662029af3","Type":"ContainerStarted","Data":"b9c36d05fceb48dde21a48a50efd95e6eeedd96b8b970082a4b88f45f9fef999"}
Jul 09 12:34:02.317562 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.317520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-65vhk" event={"ID":"27b6b789-70fd-4dc1-8c81-4add6a6dfb2f","Type":"ContainerStarted","Data":"a92e5dcf33fdd03157f46490057109494794acdfbe07026da8d421e38a29557f"}
Jul 09 12:34:02.317954 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.317620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:34:02.319151 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.319126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs" event={"ID":"f5bbed0d-c21b-423c-beb3-902662029af3","Type":"ContainerStarted","Data":"6142897a7141d1782f8b00f844f8edd0c0cb23e2d325ca0d470c9730aaa9e0b6"}
Jul 09 12:34:02.319260 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.319210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:34:02.338904 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.338853    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-65vhk" podStartSLOduration=1.9203001990000002 podStartE2EDuration="3.3388366s" totalImagesPullingTime="1.418536401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:34:02.33853826 +0000 UTC m=+558.329669426" watchObservedRunningTime="2026-07-09 12:34:02.3388366 +0000 UTC m=+558.329967749"
Jul 09 12:34:02.360390 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:02.360339    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs" podStartSLOduration=1.9140761849999999 podStartE2EDuration="3.360322737s" totalImagesPullingTime="1.446246552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:34:02.359420622 +0000 UTC m=+558.350551773" watchObservedRunningTime="2026-07-09 12:34:02.360322737 +0000 UTC m=+558.351453887"
Jul 09 12:34:13.327070 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:13.327037    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-f24fs"
Jul 09 12:34:13.327549 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:13.327210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-65vhk"
Jul 09 12:34:27.595739 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.595707    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"]
Jul 09 12:34:27.599370 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.599352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.603676 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.603655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 12:34:27.603772 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.603746    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w26c9\""
Jul 09 12:34:27.603772 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.603750    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 12:34:27.603870 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.603760    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 12:34:27.609366 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.609345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"]
Jul 09 12:34:27.691427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.691427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.691631 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflht\" (UniqueName: \"kubernetes.io/projected/0245b594-f4c2-40b2-b9bd-3910c780d27c-kube-api-access-nflht\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.691631 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.691631 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0245b594-f4c2-40b2-b9bd-3910c780d27c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.691762 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.691685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792616 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflht\" (UniqueName: \"kubernetes.io/projected/0245b594-f4c2-40b2-b9bd-3910c780d27c-kube-api-access-nflht\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.792782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.792760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0245b594-f4c2-40b2-b9bd-3910c780d27c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.793132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.793107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.793205 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.793166    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.793352 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.793332    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.794881 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.794857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0245b594-f4c2-40b2-b9bd-3910c780d27c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.795348 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.795328    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0245b594-f4c2-40b2-b9bd-3910c780d27c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.801436 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.801415    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflht\" (UniqueName: \"kubernetes.io/projected/0245b594-f4c2-40b2-b9bd-3910c780d27c-kube-api-access-nflht\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5wlr\" (UID: \"0245b594-f4c2-40b2-b9bd-3910c780d27c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:27.909704 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:27.909639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:28.045621 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:28.045594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"]
Jul 09 12:34:28.046883 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:34:28.046857    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0245b594_f4c2_40b2_b9bd_3910c780d27c.slice/crio-2bfe9c16a1835c030acbe9a2e7e1b561b3cf4d4164cb7d21c0ed24d6d8c8c8da WatchSource:0}: Error finding container 2bfe9c16a1835c030acbe9a2e7e1b561b3cf4d4164cb7d21c0ed24d6d8c8c8da: Status 404 returned error can't find the container with id 2bfe9c16a1835c030acbe9a2e7e1b561b3cf4d4164cb7d21c0ed24d6d8c8c8da
Jul 09 12:34:28.469944 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:28.469904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr" event={"ID":"0245b594-f4c2-40b2-b9bd-3910c780d27c","Type":"ContainerStarted","Data":"2bfe9c16a1835c030acbe9a2e7e1b561b3cf4d4164cb7d21c0ed24d6d8c8c8da"}
Jul 09 12:34:29.478052 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:29.478018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr" event={"ID":"0245b594-f4c2-40b2-b9bd-3910c780d27c","Type":"ContainerStarted","Data":"bd30fe1971f90841d2fb19876804797b99a031667d89597e8fac904f9b704cf1"}
Jul 09 12:34:29.504159 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:29.504114    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr" podStartSLOduration=1.476687434 podStartE2EDuration="2.504100905s" totalImagesPullingTime="1.027413471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:34:29.502689204 +0000 UTC m=+585.493820375" watchObservedRunningTime="2026-07-09 12:34:29.504100905 +0000 UTC m=+585.495232054"
Jul 09 12:34:37.910610 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:37.910576    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:37.911080 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:37.910641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:37.922933 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:37.922905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:38.535915 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:38.535884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5wlr"
Jul 09 12:34:44.432090 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:44.432062    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:34:44.432565 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:44.432161    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:34:44.435072 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:44.435056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:34:44.435190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:44.435077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:34:48.494846 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.494813    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"]
Jul 09 12:34:48.498472 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.498452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.501361 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.501340    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 12:34:48.510293 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.510274    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"]
Jul 09 12:34:48.585160 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.585337 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnhhc\" (UniqueName: \"kubernetes.io/projected/58d580f6-78aa-474a-ba3e-6667ed8fde99-kube-api-access-xnhhc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.585337 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.585337 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.585337 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d580f6-78aa-474a-ba3e-6667ed8fde99-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.585575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.585474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.686755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.686715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.686755 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.686762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.686778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnhhc\" (UniqueName: \"kubernetes.io/projected/58d580f6-78aa-474a-ba3e-6667ed8fde99-kube-api-access-xnhhc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.686924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.686943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687227 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.687201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d580f6-78aa-474a-ba3e-6667ed8fde99-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687293 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.687198    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687498 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.687475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.687596 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.687538    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.689012 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.688992    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d580f6-78aa-474a-ba3e-6667ed8fde99-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.689382 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.689366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d580f6-78aa-474a-ba3e-6667ed8fde99-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.695785 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.695764    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnhhc\" (UniqueName: \"kubernetes.io/projected/58d580f6-78aa-474a-ba3e-6667ed8fde99-kube-api-access-xnhhc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-55676\" (UID: \"58d580f6-78aa-474a-ba3e-6667ed8fde99\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.810083 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.809990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:48.943983 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:48.943894    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"]
Jul 09 12:34:48.945670 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:34:48.945643    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d580f6_78aa_474a_ba3e_6667ed8fde99.slice/crio-ccd02424717ccd4e9e74ec9d4433e966cbc005fdd963cdd075cc340414d21531 WatchSource:0}: Error finding container ccd02424717ccd4e9e74ec9d4433e966cbc005fdd963cdd075cc340414d21531: Status 404 returned error can't find the container with id ccd02424717ccd4e9e74ec9d4433e966cbc005fdd963cdd075cc340414d21531
Jul 09 12:34:49.581979 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:49.581940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676" event={"ID":"58d580f6-78aa-474a-ba3e-6667ed8fde99","Type":"ContainerStarted","Data":"2de54c664da6cadbe570848c51aa6d956ac7cf962672217c3e5dffeb575a3bff"}
Jul 09 12:34:49.582356 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:49.582002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676" event={"ID":"58d580f6-78aa-474a-ba3e-6667ed8fde99","Type":"ContainerStarted","Data":"ccd02424717ccd4e9e74ec9d4433e966cbc005fdd963cdd075cc340414d21531"}
Jul 09 12:34:49.603290 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:49.603242    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676" podStartSLOduration=1.416336103 podStartE2EDuration="1.603226021s" totalImagesPullingTime="186.889918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:34:49.601764086 +0000 UTC m=+605.592895237" watchObservedRunningTime="2026-07-09 12:34:49.603226021 +0000 UTC m=+605.594357170"
Jul 09 12:34:58.811044 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:58.810998    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:58.813486 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:58.811079    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:58.823798 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:58.823778    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:34:59.653335 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:34:59.653306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-55676"
Jul 09 12:35:07.198299 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.198223    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"]
Jul 09 12:35:07.204558 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.204539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.207775 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.207752    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 12:35:07.215434 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.215410    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"]
Jul 09 12:35:07.358970 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.358926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-kube-api-access-qfsjz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.359132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.358977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.359132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.359082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.359132 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.359122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.359300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.359145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.359300 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.359250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.459895 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.459812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-kube-api-access-qfsjz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.459895 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.459852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460120 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.459912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460120 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.459944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460120 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.459981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460120 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.460017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460328 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.460282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460387 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.460346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.460448 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.460414    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.462227 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.462193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.462406 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.462389    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.468263 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.468242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfsjz\" (UniqueName: \"kubernetes.io/projected/5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547-kube-api-access-qfsjz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4\" (UID: \"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.515222 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.515197    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:07.651190 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.651156    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"]
Jul 09 12:35:07.651308 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:35:07.651220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd0c1f3_c5da_4c87_9b6e_e6a3eb2e4547.slice/crio-9ba072ff000cc6dda2232534400c24585dbd4087e89d692b7b932b6f076763fe WatchSource:0}: Error finding container 9ba072ff000cc6dda2232534400c24585dbd4087e89d692b7b932b6f076763fe: Status 404 returned error can't find the container with id 9ba072ff000cc6dda2232534400c24585dbd4087e89d692b7b932b6f076763fe
Jul 09 12:35:07.652743 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.652723    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 12:35:07.682198 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:07.682173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4" event={"ID":"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547","Type":"ContainerStarted","Data":"9ba072ff000cc6dda2232534400c24585dbd4087e89d692b7b932b6f076763fe"}
Jul 09 12:35:08.689415 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:08.689384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4" event={"ID":"5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547","Type":"ContainerStarted","Data":"7411c36a81a01bdf02591f9a1c7c6dc233933c4401ca2f596200d18637082e52"}
Jul 09 12:35:08.708612 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:08.708555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4" podStartSLOduration=1.504644324 podStartE2EDuration="1.708540956s" totalImagesPullingTime="203.896632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:35:08.708263602 +0000 UTC m=+624.699394753" watchObservedRunningTime="2026-07-09 12:35:08.708540956 +0000 UTC m=+624.699672105"
Jul 09 12:35:17.515626 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:17.515584    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:17.515626 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:17.515637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:17.528084 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:17.528059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:35:17.751930 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:35:17.751895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4"
Jul 09 12:37:29.992380 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:29.992346    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:37:29.992861 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:29.992558    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" podUID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" containerName="manager" containerID="cri-o://5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28" gracePeriod=30
Jul 09 12:37:30.242210 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.242185    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:37:30.314000 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.313921    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqmmr\" (UniqueName: \"kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr\") pod \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") "
Jul 09 12:37:30.314000 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.314000    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert\") pod \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\" (UID: \"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25\") "
Jul 09 12:37:30.315914 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.315878    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr" (OuterVolumeSpecName: "kube-api-access-xqmmr") pod "6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" (UID: "6d1f8832-b0d6-4347-aca2-0c12e8e2fe25"). InnerVolumeSpecName "kube-api-access-xqmmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:37:30.316035 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.316000    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" (UID: "6d1f8832-b0d6-4347-aca2-0c12e8e2fe25"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:37:30.414672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.414644    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-webhook-cert\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:37:30.414672 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.414669    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqmmr\" (UniqueName: \"kubernetes.io/projected/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25-kube-api-access-xqmmr\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:37:30.454241 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.454213    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" containerID="5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28" exitCode=0
Jul 09 12:37:30.454379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.454261    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2"
Jul 09 12:37:30.454379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.454307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" event={"ID":"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25","Type":"ContainerDied","Data":"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"}
Jul 09 12:37:30.454379 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.454363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-7wkk2" event={"ID":"6d1f8832-b0d6-4347-aca2-0c12e8e2fe25","Type":"ContainerDied","Data":"098e84bf8a409ae8455ee9359f3e37d5c6160729ccc1d53fcf970bddf74173d3"}
Jul 09 12:37:30.454553 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.454390    2573 scope.go:117] "RemoveContainer" containerID="5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"
Jul 09 12:37:30.463853 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.463835    2573 scope.go:117] "RemoveContainer" containerID="5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"
Jul 09 12:37:30.464110 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:37:30.464088    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28\": container with ID starting with 5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28 not found: ID does not exist" containerID="5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"
Jul 09 12:37:30.464168 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.464122    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28"} err="failed to get container status \"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28\": rpc error: code = NotFound desc = could not find container \"5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28\": container with ID starting with 5953ea53e629d86d9963131872346d2f35b01f1dcb9d13aabc1c2159dc9a4e28 not found: ID does not exist"
Jul 09 12:37:30.479569 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.479542    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:37:30.484438 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.484417    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-7wkk2"]
Jul 09 12:37:30.565981 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:30.565912    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" path="/var/lib/kubelet/pods/6d1f8832-b0d6-4347-aca2-0c12e8e2fe25/volumes"
Jul 09 12:37:31.369253 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.369217    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-dmdsg"]
Jul 09 12:37:31.369756 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.369617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" containerName="manager"
Jul 09 12:37:31.369756 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.369630    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" containerName="manager"
Jul 09 12:37:31.369756 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.369688    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1f8832-b0d6-4347-aca2-0c12e8e2fe25" containerName="manager"
Jul 09 12:37:31.374021 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.374001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.378043 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:37:31.378016    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-controller-6fdc6f7f5d-dmdsg\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="947a6dd3-bee2-43a2-b857-a6fcabcded2e" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.378216 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:37:31.378046    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret"
Jul 09 12:37:31.378216 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.378193    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q7frb\""
Jul 09 12:37:31.378347 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.378264    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 12:37:31.391861 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.391836    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-dmdsg"]
Jul 09 12:37:31.523858 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.523823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/947a6dd3-bee2-43a2-b857-a6fcabcded2e-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.523858 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.523856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27244\" (UniqueName: \"kubernetes.io/projected/947a6dd3-bee2-43a2-b857-a6fcabcded2e-kube-api-access-27244\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.625434 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.625338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/947a6dd3-bee2-43a2-b857-a6fcabcded2e-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.625434 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.625375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27244\" (UniqueName: \"kubernetes.io/projected/947a6dd3-bee2-43a2-b857-a6fcabcded2e-kube-api-access-27244\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:31.635207 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:31.635184    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27244\" (UniqueName: \"kubernetes.io/projected/947a6dd3-bee2-43a2-b857-a6fcabcded2e-kube-api-access-27244\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:32.419407 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:32.419376    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 12:37:32.428330 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:32.428307    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/947a6dd3-bee2-43a2-b857-a6fcabcded2e-webhook-cert\") pod \"maas-controller-6fdc6f7f5d-dmdsg\" (UID: \"947a6dd3-bee2-43a2-b857-a6fcabcded2e\") " pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:32.584376 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:32.584341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:32.929046 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:32.929018    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc6f7f5d-dmdsg"]
Jul 09 12:37:32.931312 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:37:32.931284    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947a6dd3_bee2_43a2_b857_a6fcabcded2e.slice/crio-1962f0ceaa0477c50883a25bd4e33a2625a4978767b1f1c59f747db04b2655a5 WatchSource:0}: Error finding container 1962f0ceaa0477c50883a25bd4e33a2625a4978767b1f1c59f747db04b2655a5: Status 404 returned error can't find the container with id 1962f0ceaa0477c50883a25bd4e33a2625a4978767b1f1c59f747db04b2655a5
Jul 09 12:37:33.471774 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:33.471741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg" event={"ID":"947a6dd3-bee2-43a2-b857-a6fcabcded2e","Type":"ContainerStarted","Data":"1962f0ceaa0477c50883a25bd4e33a2625a4978767b1f1c59f747db04b2655a5"}
Jul 09 12:37:34.477991 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:34.477957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg" event={"ID":"947a6dd3-bee2-43a2-b857-a6fcabcded2e","Type":"ContainerStarted","Data":"22d81f3fcfa79e4c82bebae51032bebbb5c73ad3e401909d89ab2e146330a4f9"}
Jul 09 12:37:34.478453 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:34.478083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:37:34.499932 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:34.499886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg" podStartSLOduration=2.892026727 podStartE2EDuration="3.499872188s" totalImagesPullingTime="607.845461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:37:34.496928783 +0000 UTC m=+770.488059960" watchObservedRunningTime="2026-07-09 12:37:34.499872188 +0000 UTC m=+770.491003337"
Jul 09 12:37:45.488885 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:37:45.488853    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdc6f7f5d-dmdsg"
Jul 09 12:39:44.472679 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:39:44.472647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:39:44.473150 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:39:44.472647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:39:44.475613 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:39:44.475593    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:39:44.475738 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:39:44.475686    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:42:27.103593 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:27.103557    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:42:27.104119 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:27.103838    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" podUID="7756c6cc-48d6-4337-b895-d727d1d72e10" containerName="manager" containerID="cri-o://03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6" gracePeriod=10
Jul 09 12:42:29.857829 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:29.857804    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:42:29.909873 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:29.909806    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume\") pod \"7756c6cc-48d6-4337-b895-d727d1d72e10\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") "
Jul 09 12:42:29.910029 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:29.909903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m464\" (UniqueName: \"kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464\") pod \"7756c6cc-48d6-4337-b895-d727d1d72e10\" (UID: \"7756c6cc-48d6-4337-b895-d727d1d72e10\") "
Jul 09 12:42:29.910212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:29.910189    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7756c6cc-48d6-4337-b895-d727d1d72e10" (UID: "7756c6cc-48d6-4337-b895-d727d1d72e10"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:42:29.912024 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:29.912001    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464" (OuterVolumeSpecName: "kube-api-access-5m464") pod "7756c6cc-48d6-4337-b895-d727d1d72e10" (UID: "7756c6cc-48d6-4337-b895-d727d1d72e10"). InnerVolumeSpecName "kube-api-access-5m464". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:42:30.011053 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.011017    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m464\" (UniqueName: \"kubernetes.io/projected/7756c6cc-48d6-4337-b895-d727d1d72e10-kube-api-access-5m464\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:42:30.011053 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.011046    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7756c6cc-48d6-4337-b895-d727d1d72e10-extensions-socket-volume\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:42:30.059876 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.059846    2573 generic.go:356] "Generic (PLEG): container finished" podID="7756c6cc-48d6-4337-b895-d727d1d72e10" containerID="03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6" exitCode=0
Jul 09 12:42:30.060047 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.059890    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"
Jul 09 12:42:30.060047 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.059914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" event={"ID":"7756c6cc-48d6-4337-b895-d727d1d72e10","Type":"ContainerDied","Data":"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"}
Jul 09 12:42:30.060047 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.059965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m" event={"ID":"7756c6cc-48d6-4337-b895-d727d1d72e10","Type":"ContainerDied","Data":"f0bd3134190e4366b442c4a6a52add4825d9c2ed343ef22c87f064d4a8475c80"}
Jul 09 12:42:30.060047 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.059990    2573 scope.go:117] "RemoveContainer" containerID="03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"
Jul 09 12:42:30.072488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.072472    2573 scope.go:117] "RemoveContainer" containerID="03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"
Jul 09 12:42:30.072759 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:42:30.072740    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6\": container with ID starting with 03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6 not found: ID does not exist" containerID="03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"
Jul 09 12:42:30.072801 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.072770    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6"} err="failed to get container status \"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6\": rpc error: code = NotFound desc = could not find container \"03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6\": container with ID starting with 03184b6c23d0c6e12694c01a49455927a47090ce05a6867ab005d95bec6c84d6 not found: ID does not exist"
Jul 09 12:42:30.086726 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.086703    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:42:30.091412 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.091385    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f4v2m"]
Jul 09 12:42:30.566206 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:42:30.566170    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7756c6cc-48d6-4337-b895-d727d1d72e10" path="/var/lib/kubelet/pods/7756c6cc-48d6-4337-b895-d727d1d72e10/volumes"
Jul 09 12:43:28.353150 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.353111    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"]
Jul 09 12:43:28.353602 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.353524    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7756c6cc-48d6-4337-b895-d727d1d72e10" containerName="manager"
Jul 09 12:43:28.353602 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.353536    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7756c6cc-48d6-4337-b895-d727d1d72e10" containerName="manager"
Jul 09 12:43:28.353602 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.353597    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7756c6cc-48d6-4337-b895-d727d1d72e10" containerName="manager"
Jul 09 12:43:28.356551 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.356533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.359500 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.359480    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m247t\""
Jul 09 12:43:28.367761 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.367737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"]
Jul 09 12:43:28.469145 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.469112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc47044-3429-410a-bc73-b5541ffe5b05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.469316 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.469152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx2v5\" (UniqueName: \"kubernetes.io/projected/4dc47044-3429-410a-bc73-b5541ffe5b05-kube-api-access-zx2v5\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.570042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.570006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc47044-3429-410a-bc73-b5541ffe5b05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.570042 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.570043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx2v5\" (UniqueName: \"kubernetes.io/projected/4dc47044-3429-410a-bc73-b5541ffe5b05-kube-api-access-zx2v5\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.570382 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.570363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc47044-3429-410a-bc73-b5541ffe5b05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.579782 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.579759    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx2v5\" (UniqueName: \"kubernetes.io/projected/4dc47044-3429-410a-bc73-b5541ffe5b05-kube-api-access-zx2v5\") pod \"kuadrant-operator-controller-manager-86878c769f-l9qr2\" (UID: \"4dc47044-3429-410a-bc73-b5541ffe5b05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.667833 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.667745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:28.833747 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:28.832142    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"]
Jul 09 12:43:28.835460 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:43:28.835429    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc47044_3429_410a_bc73_b5541ffe5b05.slice/crio-cfac4c3f6102b61c05a1be2c35fa717f254a32e2978a4381d30810df96fa7569 WatchSource:0}: Error finding container cfac4c3f6102b61c05a1be2c35fa717f254a32e2978a4381d30810df96fa7569: Status 404 returned error can't find the container with id cfac4c3f6102b61c05a1be2c35fa717f254a32e2978a4381d30810df96fa7569
Jul 09 12:43:29.383049 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:29.383018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2" event={"ID":"4dc47044-3429-410a-bc73-b5541ffe5b05","Type":"ContainerStarted","Data":"2e2b0fd154b6ab986f78bd5da194337ccf47cc11124b7b5bcc9971ba86b2e5de"}
Jul 09 12:43:29.383430 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:29.383073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2" event={"ID":"4dc47044-3429-410a-bc73-b5541ffe5b05","Type":"ContainerStarted","Data":"cfac4c3f6102b61c05a1be2c35fa717f254a32e2978a4381d30810df96fa7569"}
Jul 09 12:43:29.383430 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:29.383100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:43:29.407635 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:29.407589    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2" podStartSLOduration=1.407575898 podStartE2EDuration="1.407575898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:43:29.404453579 +0000 UTC m=+1125.395584761" watchObservedRunningTime="2026-07-09 12:43:29.407575898 +0000 UTC m=+1125.398707048"
Jul 09 12:43:40.390467 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:43:40.390435    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l9qr2"
Jul 09 12:44:44.509573 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:44:44.509548    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:44:44.511212 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:44:44.511194    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:44:44.512446 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:44:44.512430    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:44:44.513872 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:44:44.513855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:49:44.553117 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:49:44.553084    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:49:44.556929 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:49:44.556901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:49:44.559071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:49:44.559050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:49:44.562581 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:49:44.562562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:53:40.423566 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.423530    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:53:40.427310 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.427292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.439358 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.439334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a0a88c96\"/\"default-dockercfg-lw2tr\""
Jul 09 12:53:40.439358 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.439349    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a0a88c96\"/\"openshift-service-ca.crt\""
Jul 09 12:53:40.441372 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.441350    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a0a88c96\"/\"e2e-lifecycle-model-a0a88c96-kserve-self-signed-certs\""
Jul 09 12:53:40.442594 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.442576    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a0a88c96\"/\"kube-root-ca.crt\""
Jul 09 12:53:40.461320 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.461293    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:53:40.553711 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.553900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.553900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.553900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.553900 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.554039 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.553928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr4ll\" (UniqueName: \"kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655016 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.654987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655214 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655214 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655214 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655467 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655393    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655539 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655539 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr4ll\" (UniqueName: \"kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.655749 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.655728    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.657492 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.657467    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.657657 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.657643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.667436 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.667416    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr4ll\" (UniqueName: \"kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll\") pod \"e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") " pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.737414 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.737384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:40.884534 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:40.884487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:53:40.886384 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:53:40.886356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33565f63_5f04_4a89_bc22_426c1b4eda83.slice/crio-7824c6e488adb249957e19a87d50dec152ec928693410a4f4e9fc1e1aa84b0c8 WatchSource:0}: Error finding container 7824c6e488adb249957e19a87d50dec152ec928693410a4f4e9fc1e1aa84b0c8: Status 404 returned error can't find the container with id 7824c6e488adb249957e19a87d50dec152ec928693410a4f4e9fc1e1aa84b0c8
Jul 09 12:53:41.676857 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:41.676820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" event={"ID":"33565f63-5f04-4a89-bc22-426c1b4eda83","Type":"ContainerStarted","Data":"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"}
Jul 09 12:53:41.677216 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:41.676872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" event={"ID":"33565f63-5f04-4a89-bc22-426c1b4eda83","Type":"ContainerStarted","Data":"7824c6e488adb249957e19a87d50dec152ec928693410a4f4e9fc1e1aa84b0c8"}
Jul 09 12:53:41.700545 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:41.700478    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" podStartSLOduration=1.7004640819999999 podStartE2EDuration="1.700464082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:53:41.698494866 +0000 UTC m=+1737.689626017" watchObservedRunningTime="2026-07-09 12:53:41.700464082 +0000 UTC m=+1737.691595232"
Jul 09 12:53:50.738082 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:50.738051    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:50.738550 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:50.738152    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:50.751667 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:50.751638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:53:51.740341 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:53:51.740306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:54:18.482193 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:18.482159    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:54:33.503080 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.503033    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" podUID="33565f63-5f04-4a89-bc22-426c1b4eda83" containerName="main" containerID="cri-o://5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88" gracePeriod=45
Jul 09 12:54:33.750142 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.750117    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:54:33.872929 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.872845    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.872929 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.872890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr4ll\" (UniqueName: \"kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.873217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.872936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.873217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.872965    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.873217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873036    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.873217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873066    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm\") pod \"33565f63-5f04-4a89-bc22-426c1b4eda83\" (UID: \"33565f63-5f04-4a89-bc22-426c1b4eda83\") "
Jul 09 12:54:33.873217 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873168    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home" (OuterVolumeSpecName: "home") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:54:33.873480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873222    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache" (OuterVolumeSpecName: "model-cache") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:54:33.873480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873291    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:54:33.873480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873447    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.873480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873461    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.873480 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.873471    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.875152 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.875130    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll" (OuterVolumeSpecName: "kube-api-access-hr4ll") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "kube-api-access-hr4ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:54:33.875152 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.875137    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm" (OuterVolumeSpecName: "dshm") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:54:33.875272 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.875197    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33565f63-5f04-4a89-bc22-426c1b4eda83" (UID: "33565f63-5f04-4a89-bc22-426c1b4eda83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:54:33.971499 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.971468    2573 generic.go:356] "Generic (PLEG): container finished" podID="33565f63-5f04-4a89-bc22-426c1b4eda83" containerID="5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88" exitCode=0
Jul 09 12:54:33.971649 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.971546    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"
Jul 09 12:54:33.971649 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.971559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" event={"ID":"33565f63-5f04-4a89-bc22-426c1b4eda83","Type":"ContainerDied","Data":"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"}
Jul 09 12:54:33.971649 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.971602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk" event={"ID":"33565f63-5f04-4a89-bc22-426c1b4eda83","Type":"ContainerDied","Data":"7824c6e488adb249957e19a87d50dec152ec928693410a4f4e9fc1e1aa84b0c8"}
Jul 09 12:54:33.971649 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.971620    2573 scope.go:117] "RemoveContainer" containerID="5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"
Jul 09 12:54:33.974060 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.974038    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr4ll\" (UniqueName: \"kubernetes.io/projected/33565f63-5f04-4a89-bc22-426c1b4eda83-kube-api-access-hr4ll\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.974159 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.974066    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33565f63-5f04-4a89-bc22-426c1b4eda83-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.974159 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.974082    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33565f63-5f04-4a89-bc22-426c1b4eda83-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:54:33.980185 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.980169    2573 scope.go:117] "RemoveContainer" containerID="5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"
Jul 09 12:54:33.980418 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:54:33.980401    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88\": container with ID starting with 5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88 not found: ID does not exist" containerID="5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"
Jul 09 12:54:33.980468 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.980426    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88"} err="failed to get container status \"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88\": rpc error: code = NotFound desc = could not find container \"5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88\": container with ID starting with 5af18f938834a35e62bb9b5691e9ac05b968368016cfa55b1380fa457a34aa88 not found: ID does not exist"
Jul 09 12:54:33.994481 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.994459    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:54:33.998369 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:33.998350    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a0a88c96/e2e-lifecycle-model-a0a88c96-kserve-f8496d86c-v99qk"]
Jul 09 12:54:34.573171 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:34.573124    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33565f63-5f04-4a89-bc22-426c1b4eda83" path="/var/lib/kubelet/pods/33565f63-5f04-4a89-bc22-426c1b4eda83/volumes"
Jul 09 12:54:44.592071 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:44.591970    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:54:44.599075 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:44.594808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:54:44.603136 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:44.603114    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:54:44.605730 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:54:44.605714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:56:23.899219 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.899135    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:56:23.899867 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.899578    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33565f63-5f04-4a89-bc22-426c1b4eda83" containerName="main"
Jul 09 12:56:23.899867 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.899590    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33565f63-5f04-4a89-bc22-426c1b4eda83" containerName="main"
Jul 09 12:56:23.899867 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.899668    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33565f63-5f04-4a89-bc22-426c1b4eda83" containerName="main"
Jul 09 12:56:23.902951 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.902935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:23.907162 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.907137    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-39792d\"/\"openshift-service-ca.crt\""
Jul 09 12:56:23.907292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.907194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-39792d\"/\"test-model-39792d-kserve-self-signed-certs\""
Jul 09 12:56:23.907292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.907215    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-39792d\"/\"kube-root-ca.crt\""
Jul 09 12:56:23.907292 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.907202    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-39792d\"/\"default-dockercfg-lllpv\""
Jul 09 12:56:23.915244 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:23.915222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:56:24.012635 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mflw5\" (UniqueName: \"kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.012766 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.012766 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.012839 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.012839 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.012907 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.012838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.113915 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.113883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.113930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.113948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.113984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mflw5\" (UniqueName: \"kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.114008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114050 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.114030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114376 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.114342    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.114355    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.114488 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.114448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.116189 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.116169    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.116456 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.116438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.123067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.123050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mflw5\" (UniqueName: \"kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5\") pod \"test-model-39792d-kserve-777b57994f-82vgs\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") " pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.212236 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.212163    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:24.346295 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.346271    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:56:24.348355 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:56:24.348325    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb053882_669c_414a_9f1f_69a92d801b39.slice/crio-1c9b1dafb9bbde69f10fbcadcd3a723e5451cd282747de7d84db85b615e262ea WatchSource:0}: Error finding container 1c9b1dafb9bbde69f10fbcadcd3a723e5451cd282747de7d84db85b615e262ea: Status 404 returned error can't find the container with id 1c9b1dafb9bbde69f10fbcadcd3a723e5451cd282747de7d84db85b615e262ea
Jul 09 12:56:24.567205 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.567170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" event={"ID":"fb053882-669c-414a-9f1f-69a92d801b39","Type":"ContainerStarted","Data":"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"}
Jul 09 12:56:24.567366 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.567212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" event={"ID":"fb053882-669c-414a-9f1f-69a92d801b39","Type":"ContainerStarted","Data":"1c9b1dafb9bbde69f10fbcadcd3a723e5451cd282747de7d84db85b615e262ea"}
Jul 09 12:56:24.588950 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:24.588898    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" podStartSLOduration=1.5888832499999999 podStartE2EDuration="1.58888325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:56:24.586850876 +0000 UTC m=+1900.577982038" watchObservedRunningTime="2026-07-09 12:56:24.58888325 +0000 UTC m=+1900.580014399"
Jul 09 12:56:34.212553 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:34.212488    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:34.212553 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:34.212560    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:34.225027 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:34.225005    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:56:34.628110 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:56:34.628083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:57:13.188465 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:13.188432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:57:28.208232 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.208164    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" podUID="fb053882-669c-414a-9f1f-69a92d801b39" containerName="main" containerID="cri-o://cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a" gracePeriod=45
Jul 09 12:57:28.461894 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.461835    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:57:28.533770 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.533739    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.533956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.533830    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.533956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.533929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.533956 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.533953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.534124 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534000    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mflw5\" (UniqueName: \"kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.534124 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534027    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm\") pod \"fb053882-669c-414a-9f1f-69a92d801b39\" (UID: \"fb053882-669c-414a-9f1f-69a92d801b39\") "
Jul 09 12:57:28.534124 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534046    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:57:28.534264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534206    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:57:28.534264 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534215    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home" (OuterVolumeSpecName: "home") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:57:28.534361 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534342    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.534397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534362    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.534397 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.534380    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.536410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.536381    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5" (OuterVolumeSpecName: "kube-api-access-mflw5") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "kube-api-access-mflw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 12:57:28.536410 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.536379    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm" (OuterVolumeSpecName: "dshm") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 12:57:28.536625 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.536389    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb053882-669c-414a-9f1f-69a92d801b39" (UID: "fb053882-669c-414a-9f1f-69a92d801b39"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 12:57:28.635611 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.635578    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mflw5\" (UniqueName: \"kubernetes.io/projected/fb053882-669c-414a-9f1f-69a92d801b39-kube-api-access-mflw5\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.635841 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.635816    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb053882-669c-414a-9f1f-69a92d801b39-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.635841 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.635839    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb053882-669c-414a-9f1f-69a92d801b39-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 12:57:28.913821 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.913788    2573 generic.go:356] "Generic (PLEG): container finished" podID="fb053882-669c-414a-9f1f-69a92d801b39" containerID="cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a" exitCode=0
Jul 09 12:57:28.913992 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.913829    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"
Jul 09 12:57:28.913992 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.913869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" event={"ID":"fb053882-669c-414a-9f1f-69a92d801b39","Type":"ContainerDied","Data":"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"}
Jul 09 12:57:28.913992 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.913909    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs" event={"ID":"fb053882-669c-414a-9f1f-69a92d801b39","Type":"ContainerDied","Data":"1c9b1dafb9bbde69f10fbcadcd3a723e5451cd282747de7d84db85b615e262ea"}
Jul 09 12:57:28.913992 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.913925    2573 scope.go:117] "RemoveContainer" containerID="cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"
Jul 09 12:57:28.923066 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.923052    2573 scope.go:117] "RemoveContainer" containerID="cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"
Jul 09 12:57:28.923303 ip-10-0-140-238 kubenswrapper[2573]: E0709 12:57:28.923284    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a\": container with ID starting with cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a not found: ID does not exist" containerID="cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"
Jul 09 12:57:28.923353 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.923315    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a"} err="failed to get container status \"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a\": rpc error: code = NotFound desc = could not find container \"cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a\": container with ID starting with cad921eade1a4f599a88c3c7ebceff55f3a1a51e3159ed687cd0ffc41ddf575a not found: ID does not exist"
Jul 09 12:57:28.954228 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.954205    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:57:28.962020 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:28.962000    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-39792d/test-model-39792d-kserve-777b57994f-82vgs"]
Jul 09 12:57:30.567051 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:57:30.567010    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb053882-669c-414a-9f1f-69a92d801b39" path="/var/lib/kubelet/pods/fb053882-669c-414a-9f1f-69a92d801b39/volumes"
Jul 09 12:59:35.096962 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.096876    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 12:59:35.097439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.097257    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb053882-669c-414a-9f1f-69a92d801b39" containerName="main"
Jul 09 12:59:35.097439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.097268    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb053882-669c-414a-9f1f-69a92d801b39" containerName="main"
Jul 09 12:59:35.097439 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.097352    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb053882-669c-414a-9f1f-69a92d801b39" containerName="main"
Jul 09 12:59:35.100689 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.100669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.103642 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.103618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"openshift-service-ca.crt\""
Jul 09 12:59:35.103771 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.103666    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"auth-test-model-83cace-kserve-self-signed-certs\""
Jul 09 12:59:35.104861 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.104841    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"kube-root-ca.crt\""
Jul 09 12:59:35.104967 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.104876    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"default-dockercfg-nr6wd\""
Jul 09 12:59:35.110311 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.110287    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 12:59:35.187946 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.187912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.188133 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.187961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.188133 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.187994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.188133 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.188019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.188133 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.188083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.188274 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.188140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8z6\" (UniqueName: \"kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289243 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8z6\" (UniqueName: \"kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289427 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289676 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289770 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289753    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289843 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289822    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.289893 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.289845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.291527 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.291494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.291910 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.291892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.301760 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.301738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8z6\" (UniqueName: \"kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6\") pod \"auth-test-model-83cace-kserve-7bfd4d64cf-2nz99\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") " pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.410575 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.410444    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:35.572227 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.572202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 12:59:35.573605 ip-10-0-140-238 kubenswrapper[2573]: W0709 12:59:35.573581    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc41f982_3e70_48ac_9fbe_d8c9a70a505d.slice/crio-0b0728b8a64d5b0252c09e0678f29bf4aca3b1efd379de0a75375120bc07646f WatchSource:0}: Error finding container 0b0728b8a64d5b0252c09e0678f29bf4aca3b1efd379de0a75375120bc07646f: Status 404 returned error can't find the container with id 0b0728b8a64d5b0252c09e0678f29bf4aca3b1efd379de0a75375120bc07646f
Jul 09 12:59:35.607067 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:35.607031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" event={"ID":"dc41f982-3e70-48ac-9fbe-d8c9a70a505d","Type":"ContainerStarted","Data":"0b0728b8a64d5b0252c09e0678f29bf4aca3b1efd379de0a75375120bc07646f"}
Jul 09 12:59:36.613883 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:36.613841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" event={"ID":"dc41f982-3e70-48ac-9fbe-d8c9a70a505d","Type":"ContainerStarted","Data":"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"}
Jul 09 12:59:36.651606 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:36.651550    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" podStartSLOduration=1.651535273 podStartE2EDuration="1.651535273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 12:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 12:59:36.648495429 +0000 UTC m=+2092.639626583" watchObservedRunningTime="2026-07-09 12:59:36.651535273 +0000 UTC m=+2092.642666423"
Jul 09 12:59:44.630306 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:44.630191    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:59:44.645004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:44.633161    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:59:44.645004 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:44.642810    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 12:59:44.646003 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:44.645986    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 12:59:45.411009 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:45.410973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:45.411191 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:45.411025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:45.423568 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:45.423541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 12:59:45.673445 ip-10-0-140-238 kubenswrapper[2573]: I0709 12:59:45.673356    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 13:02:12.894526 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:12.894436    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 13:02:27.914342 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:27.914280    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" podUID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" containerName="main" containerID="cri-o://58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2" gracePeriod=45
Jul 09 13:02:28.162489 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.162464    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 13:02:28.337901 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.337871    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk8z6\" (UniqueName: \"kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.337901 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.337906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.338140 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.337956    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.338140 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338018    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.338140 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338092    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.338140 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338127    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs\") pod \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\" (UID: \"dc41f982-3e70-48ac-9fbe-d8c9a70a505d\") "
Jul 09 13:02:28.338353 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338242    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:02:28.338353 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338260    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home" (OuterVolumeSpecName: "home") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:02:28.338433 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338378    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:02:28.338535 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338494    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.338587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338540    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.338587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.338558    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.340180 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.340147    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:02:28.340180 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.340169    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6" (OuterVolumeSpecName: "kube-api-access-lk8z6") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "kube-api-access-lk8z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:02:28.340318 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.340240    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm" (OuterVolumeSpecName: "dshm") pod "dc41f982-3e70-48ac-9fbe-d8c9a70a505d" (UID: "dc41f982-3e70-48ac-9fbe-d8c9a70a505d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:02:28.439790 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.439763    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.439790 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.439788    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk8z6\" (UniqueName: \"kubernetes.io/projected/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-kube-api-access-lk8z6\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.439943 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.439798    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc41f982-3e70-48ac-9fbe-d8c9a70a505d-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:02:28.538124 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.538096    2573 generic.go:356] "Generic (PLEG): container finished" podID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" containerID="58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2" exitCode=0
Jul 09 13:02:28.538279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.538140    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"
Jul 09 13:02:28.538279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.538139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" event={"ID":"dc41f982-3e70-48ac-9fbe-d8c9a70a505d","Type":"ContainerDied","Data":"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"}
Jul 09 13:02:28.538279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.538193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99" event={"ID":"dc41f982-3e70-48ac-9fbe-d8c9a70a505d","Type":"ContainerDied","Data":"0b0728b8a64d5b0252c09e0678f29bf4aca3b1efd379de0a75375120bc07646f"}
Jul 09 13:02:28.538279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.538217    2573 scope.go:117] "RemoveContainer" containerID="58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"
Jul 09 13:02:28.547897 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.547887    2573 scope.go:117] "RemoveContainer" containerID="58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"
Jul 09 13:02:28.548131 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:02:28.548110    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2\": container with ID starting with 58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2 not found: ID does not exist" containerID="58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"
Jul 09 13:02:28.548195 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.548141    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2"} err="failed to get container status \"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2\": rpc error: code = NotFound desc = could not find container \"58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2\": container with ID starting with 58d9086e1b66d06444f8e5a2b0343b4814c9206d7d9fd10816c0df4a4e3f22e2 not found: ID does not exist"
Jul 09 13:02:28.566147 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.566128    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 13:02:28.566240 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:28.566156    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/auth-test-model-83cace-kserve-7bfd4d64cf-2nz99"]
Jul 09 13:02:30.566581 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:30.566554    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" path="/var/lib/kubelet/pods/dc41f982-3e70-48ac-9fbe-d8c9a70a505d/volumes"
Jul 09 13:02:33.417927 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.417895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:02:33.418295 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.418283    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" containerName="main"
Jul 09 13:02:33.418339 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.418298    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" containerName="main"
Jul 09 13:02:33.418378 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.418363    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc41f982-3e70-48ac-9fbe-d8c9a70a505d" containerName="main"
Jul 09 13:02:33.423071 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.423038    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.427172 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.427148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"openshift-service-ca.crt\""
Jul 09 13:02:33.427308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.427177    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"default-dockercfg-nr6wd\""
Jul 09 13:02:33.427308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.427223    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"sub-test-model-83cace-kserve-self-signed-certs\""
Jul 09 13:02:33.427308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.427148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-83cace\"/\"kube-root-ca.crt\""
Jul 09 13:02:33.430848 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.430821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:02:33.475549 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.475653 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.475653 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.475653 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.475653 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.475789 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.475723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzwt\" (UniqueName: \"kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576139 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576253 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576253 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576253 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576253 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzwt\" (UniqueName: \"kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576441 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576640 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576618    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576712 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576655    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.576712 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.576700    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.578413 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.578394    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.578832 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.578811    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.584937 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.584917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzwt\" (UniqueName: \"kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt\") pod \"sub-test-model-83cace-kserve-76dbffd56f-n6mwf\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") " pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.736018 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.735987    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:33.875609 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:33.874126    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:02:33.879192 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:02:33.879157    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e5365f5_0c98_4517_8ede_a84b442278a7.slice/crio-57592b078b01935288911fea0f34dd3ed620a85238299a99ec63e8dd94c73fc2 WatchSource:0}: Error finding container 57592b078b01935288911fea0f34dd3ed620a85238299a99ec63e8dd94c73fc2: Status 404 returned error can't find the container with id 57592b078b01935288911fea0f34dd3ed620a85238299a99ec63e8dd94c73fc2
Jul 09 13:02:34.571135 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:34.571102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" event={"ID":"3e5365f5-0c98-4517-8ede-a84b442278a7","Type":"ContainerStarted","Data":"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"}
Jul 09 13:02:34.571135 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:34.571139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" event={"ID":"3e5365f5-0c98-4517-8ede-a84b442278a7","Type":"ContainerStarted","Data":"57592b078b01935288911fea0f34dd3ed620a85238299a99ec63e8dd94c73fc2"}
Jul 09 13:02:34.593669 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:34.593620    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" podStartSLOduration=1.593604748 podStartE2EDuration="1.593604748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:02:34.591502811 +0000 UTC m=+2270.582633962" watchObservedRunningTime="2026-07-09 13:02:34.593604748 +0000 UTC m=+2270.584735899"
Jul 09 13:02:43.737058 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:43.737017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:43.737502 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:43.737090    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:43.750711 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:43.750682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:02:44.637574 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:02:44.637546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:03:11.561191 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.561153    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:03:11.565000 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.564979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.572992 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.572968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"openshift-service-ca.crt\""
Jul 09 13:03:11.573218 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.573199    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"default-dockercfg-cnddb\""
Jul 09 13:03:11.573920 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.573903    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"kube-root-ca.crt\""
Jul 09 13:03:11.574115 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.574086    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"sub-test-model-d5cca2-kserve-self-signed-certs\""
Jul 09 13:03:11.588879 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.588856    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:03:11.736420 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.736420 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.736686 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.736686 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.736686 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjr7\" (UniqueName: \"kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.736817 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.736708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837398 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837398 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837398 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjr7\" (UniqueName: \"kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837688 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837688 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837688 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837882 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837859    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837925 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.837925 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.837915    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.839614 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.839594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.839882 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.839865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.865285 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.865257    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjr7\" (UniqueName: \"kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7\") pod \"sub-test-model-d5cca2-kserve-86f6db896c-66xk4\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") " pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:11.874264 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:11.874223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:12.019328 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:12.019296    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:03:12.020067 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:03:12.020042    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6b1fcfa_29d9_4d35_adcb_d49e9944b152.slice/crio-f1954bc8c0805169f85923a4c74796cbf597294d1e1372d9cea38d435b49eed6 WatchSource:0}: Error finding container f1954bc8c0805169f85923a4c74796cbf597294d1e1372d9cea38d435b49eed6: Status 404 returned error can't find the container with id f1954bc8c0805169f85923a4c74796cbf597294d1e1372d9cea38d435b49eed6
Jul 09 13:03:12.783361 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:12.783322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" event={"ID":"c6b1fcfa-29d9-4d35-adcb-d49e9944b152","Type":"ContainerStarted","Data":"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"}
Jul 09 13:03:12.783805 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:12.783370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" event={"ID":"c6b1fcfa-29d9-4d35-adcb-d49e9944b152","Type":"ContainerStarted","Data":"f1954bc8c0805169f85923a4c74796cbf597294d1e1372d9cea38d435b49eed6"}
Jul 09 13:03:12.842442 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:12.842375    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" podStartSLOduration=1.8423560289999998 podStartE2EDuration="1.842356029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:03:12.842324267 +0000 UTC m=+2308.833455419" watchObservedRunningTime="2026-07-09 13:03:12.842356029 +0000 UTC m=+2308.833487181"
Jul 09 13:03:21.874772 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:21.874732    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:21.874772 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:21.874779    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:21.887503 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:21.887475    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:22.849672 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:22.849638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:03:52.584173 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:52.584136    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:03:53.502701 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:03:53.502669    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:04:07.604503 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.604459    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" podUID="3e5365f5-0c98-4517-8ede-a84b442278a7" containerName="main" containerID="cri-o://7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17" gracePeriod=45
Jul 09 13:04:07.855467 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.855411    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:04:07.983286 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983286 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983298    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983534 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983534 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983376    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvzwt\" (UniqueName: \"kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983534 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983395    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983534 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983465    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs\") pod \"3e5365f5-0c98-4517-8ede-a84b442278a7\" (UID: \"3e5365f5-0c98-4517-8ede-a84b442278a7\") "
Jul 09 13:04:07.983760 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983586    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:07.983760 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983648    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home" (OuterVolumeSpecName: "home") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:07.983868 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983768    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:07.983936 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983917    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:07.984000 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983943    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:07.984000 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.983964    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:07.985610 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.985584    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm" (OuterVolumeSpecName: "dshm") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:07.985610 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.985597    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt" (OuterVolumeSpecName: "kube-api-access-hvzwt") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "kube-api-access-hvzwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:04:07.985757 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:07.985586    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e5365f5-0c98-4517-8ede-a84b442278a7" (UID: "3e5365f5-0c98-4517-8ede-a84b442278a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:04:08.087587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.085285    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5365f5-0c98-4517-8ede-a84b442278a7-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.087587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.085338    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvzwt\" (UniqueName: \"kubernetes.io/projected/3e5365f5-0c98-4517-8ede-a84b442278a7-kube-api-access-hvzwt\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.087587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.085355    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5365f5-0c98-4517-8ede-a84b442278a7-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.095536 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.095480    2573 generic.go:356] "Generic (PLEG): container finished" podID="3e5365f5-0c98-4517-8ede-a84b442278a7" containerID="7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17" exitCode=0
Jul 09 13:04:08.095694 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.095555    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"
Jul 09 13:04:08.095694 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.095565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" event={"ID":"3e5365f5-0c98-4517-8ede-a84b442278a7","Type":"ContainerDied","Data":"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"}
Jul 09 13:04:08.095694 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.095609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf" event={"ID":"3e5365f5-0c98-4517-8ede-a84b442278a7","Type":"ContainerDied","Data":"57592b078b01935288911fea0f34dd3ed620a85238299a99ec63e8dd94c73fc2"}
Jul 09 13:04:08.095694 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.095626    2573 scope.go:117] "RemoveContainer" containerID="7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"
Jul 09 13:04:08.105142 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.105127    2573 scope.go:117] "RemoveContainer" containerID="7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"
Jul 09 13:04:08.105379 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:04:08.105362    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17\": container with ID starting with 7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17 not found: ID does not exist" containerID="7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"
Jul 09 13:04:08.105419 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.105389    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17"} err="failed to get container status \"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17\": rpc error: code = NotFound desc = could not find container \"7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17\": container with ID starting with 7064f43b0e05722c16b4cb8bc0a393f17d6437d1944252538bbf9722a1f0bc17 not found: ID does not exist"
Jul 09 13:04:08.119967 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.119903    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:04:08.124497 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.124465    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-83cace/sub-test-model-83cace-kserve-76dbffd56f-n6mwf"]
Jul 09 13:04:08.523425 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.523381    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" podUID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" containerName="main" containerID="cri-o://83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6" gracePeriod=45
Jul 09 13:04:08.567609 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.567578    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5365f5-0c98-4517-8ede-a84b442278a7" path="/var/lib/kubelet/pods/3e5365f5-0c98-4517-8ede-a84b442278a7/volumes"
Jul 09 13:04:08.775873 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.775807    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:04:08.891657 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.891821 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891726    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djjr7\" (UniqueName: \"kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.891821 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891777    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.891821 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891806    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.892008 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891847    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.892008 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.891907    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir\") pod \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\" (UID: \"c6b1fcfa-29d9-4d35-adcb-d49e9944b152\") "
Jul 09 13:04:08.892165 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892079    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:08.892165 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892122    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home" (OuterVolumeSpecName: "home") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:08.892279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892163    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:08.892279 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892269    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.892361 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892281    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.892361 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.892291    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.893952 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.893927    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:04:08.894188 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.894165    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm" (OuterVolumeSpecName: "dshm") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:04:08.894244 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.894167    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7" (OuterVolumeSpecName: "kube-api-access-djjr7") pod "c6b1fcfa-29d9-4d35-adcb-d49e9944b152" (UID: "c6b1fcfa-29d9-4d35-adcb-d49e9944b152"). InnerVolumeSpecName "kube-api-access-djjr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:04:08.993481 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.993452    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djjr7\" (UniqueName: \"kubernetes.io/projected/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-kube-api-access-djjr7\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.993481 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.993477    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:08.993481 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:08.993487    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b1fcfa-29d9-4d35-adcb-d49e9944b152-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:04:09.103281 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.103198    2573 generic.go:356] "Generic (PLEG): container finished" podID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" containerID="83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6" exitCode=0
Jul 09 13:04:09.103281 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.103242    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"
Jul 09 13:04:09.103530 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.103294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" event={"ID":"c6b1fcfa-29d9-4d35-adcb-d49e9944b152","Type":"ContainerDied","Data":"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"}
Jul 09 13:04:09.103530 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.103338    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4" event={"ID":"c6b1fcfa-29d9-4d35-adcb-d49e9944b152","Type":"ContainerDied","Data":"f1954bc8c0805169f85923a4c74796cbf597294d1e1372d9cea38d435b49eed6"}
Jul 09 13:04:09.103530 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.103362    2573 scope.go:117] "RemoveContainer" containerID="83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"
Jul 09 13:04:09.112779 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.112761    2573 scope.go:117] "RemoveContainer" containerID="83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"
Jul 09 13:04:09.113002 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:04:09.112983    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6\": container with ID starting with 83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6 not found: ID does not exist" containerID="83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"
Jul 09 13:04:09.113044 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.113010    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6"} err="failed to get container status \"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6\": rpc error: code = NotFound desc = could not find container \"83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6\": container with ID starting with 83c64b39751ccbb17bd2e9d5af973132ba388badab72996500394aa5a4e0c3a6 not found: ID does not exist"
Jul 09 13:04:09.127551 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.127522    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:04:09.132165 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:09.132143    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/sub-test-model-d5cca2-kserve-86f6db896c-66xk4"]
Jul 09 13:04:10.566956 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:10.566926    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" path="/var/lib/kubelet/pods/c6b1fcfa-29d9-4d35-adcb-d49e9944b152/volumes"
Jul 09 13:04:31.627436 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627396    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:04:31.627853 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627803    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" containerName="main"
Jul 09 13:04:31.627853 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627816    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" containerName="main"
Jul 09 13:04:31.627853 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627826    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5365f5-0c98-4517-8ede-a84b442278a7" containerName="main"
Jul 09 13:04:31.627853 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627832    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5365f5-0c98-4517-8ede-a84b442278a7" containerName="main"
Jul 09 13:04:31.628027 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627903    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5365f5-0c98-4517-8ede-a84b442278a7" containerName="main"
Jul 09 13:04:31.628027 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.627913    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b1fcfa-29d9-4d35-adcb-d49e9944b152" containerName="main"
Jul 09 13:04:31.631152 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.631132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.638731 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.638711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"kube-root-ca.crt\""
Jul 09 13:04:31.638859 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.638757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"rate-test-model-d5cca2-kserve-self-signed-certs\""
Jul 09 13:04:31.639012 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.638995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"openshift-service-ca.crt\""
Jul 09 13:04:31.639086 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.639007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5cca2\"/\"default-dockercfg-cnddb\""
Jul 09 13:04:31.648346 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.648318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:04:31.805308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxzlc\" (UniqueName: \"kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.805308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.805564 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.805564 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.805564 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.805564 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.805501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906314 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906314 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxzlc\" (UniqueName: \"kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906553 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906553 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906553 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906553 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906874 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906849    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906874 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906866    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.906973 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.906904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.908657 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.908635    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.908743 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.908728    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.917856 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.917834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxzlc\" (UniqueName: \"kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc\") pod \"rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") " pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:31.940734 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:31.940710    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:32.084280 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:32.084247    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:04:32.085277 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:04:32.085233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc74347a2_c813_44d6_8d42_af3aba9ce76a.slice/crio-442920fb507df44db8b36eaf19a0879f0411d31b8a431e93a105dab53ac7d190 WatchSource:0}: Error finding container 442920fb507df44db8b36eaf19a0879f0411d31b8a431e93a105dab53ac7d190: Status 404 returned error can't find the container with id 442920fb507df44db8b36eaf19a0879f0411d31b8a431e93a105dab53ac7d190
Jul 09 13:04:32.235767 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:32.235722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" event={"ID":"c74347a2-c813-44d6-8d42-af3aba9ce76a","Type":"ContainerStarted","Data":"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"}
Jul 09 13:04:32.235939 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:32.235775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" event={"ID":"c74347a2-c813-44d6-8d42-af3aba9ce76a","Type":"ContainerStarted","Data":"442920fb507df44db8b36eaf19a0879f0411d31b8a431e93a105dab53ac7d190"}
Jul 09 13:04:32.262067 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:32.262008    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" podStartSLOduration=1.2619926590000001 podStartE2EDuration="1.261992659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:04:32.260451585 +0000 UTC m=+2388.251582759" watchObservedRunningTime="2026-07-09 13:04:32.261992659 +0000 UTC m=+2388.253123808"
Jul 09 13:04:41.941355 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:41.941297    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:41.941900 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:41.941385    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:41.957210 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:41.957180    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:42.300500 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:42.300466    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:04:44.669749 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:44.669636    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 13:04:44.674131 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:44.672559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 13:04:44.684295 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:44.684278    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dv756_66d57738-0165-4d49-8fb1-7cb8f55f9548/kube-multus/0.log"
Jul 09 13:04:44.687247 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:04:44.687230    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whd8c_9b7ebc4b-5725-4dd5-9f46-0132af15a284/ovn-acl-logging/0.log"
Jul 09 13:05:23.107797 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:23.107759    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:05:24.255299 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.255258    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7471-140089823955632"]
Jul 09 13:05:24.258978 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.258952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:24.262220 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.262186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-7bp7g\""
Jul 09 13:05:24.264475 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.264445    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089823955632"]
Jul 09 13:05:24.309374 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.309332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdq6s\" (UniqueName: \"kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s\") pod \"test-curl-7471-140089823955632\" (UID: \"5d862a07-a296-4c72-811d-80f72df1799d\") " pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:24.410897 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.410856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdq6s\" (UniqueName: \"kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s\") pod \"test-curl-7471-140089823955632\" (UID: \"5d862a07-a296-4c72-811d-80f72df1799d\") " pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:24.419911 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.419874    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdq6s\" (UniqueName: \"kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s\") pod \"test-curl-7471-140089823955632\" (UID: \"5d862a07-a296-4c72-811d-80f72df1799d\") " pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:24.570777 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.570705    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:24.704274 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.704245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089823955632"]
Jul 09 13:05:24.705878 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:05:24.705846    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d862a07_a296_4c72_811d_80f72df1799d.slice/crio-b6e25e961d36c0bd1957299db5fa1b454ef4417f1e404e2281b1e55c77b62644 WatchSource:0}: Error finding container b6e25e961d36c0bd1957299db5fa1b454ef4417f1e404e2281b1e55c77b62644: Status 404 returned error can't find the container with id b6e25e961d36c0bd1957299db5fa1b454ef4417f1e404e2281b1e55c77b62644
Jul 09 13:05:24.707147 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:24.707129    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:05:25.523809 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:25.523773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089823955632" event={"ID":"5d862a07-a296-4c72-811d-80f72df1799d","Type":"ContainerStarted","Data":"b6e25e961d36c0bd1957299db5fa1b454ef4417f1e404e2281b1e55c77b62644"}
Jul 09 13:05:26.530776 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:26.530746    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d862a07-a296-4c72-811d-80f72df1799d" containerID="f24396f777c1dca060932e57cd11b2bacd0a190792a8b2ef6ad0d0a4285d5d96" exitCode=0
Jul 09 13:05:26.531132 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:26.530808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089823955632" event={"ID":"5d862a07-a296-4c72-811d-80f72df1799d","Type":"ContainerDied","Data":"f24396f777c1dca060932e57cd11b2bacd0a190792a8b2ef6ad0d0a4285d5d96"}
Jul 09 13:05:27.678200 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.678177    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:27.718517 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.718489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7471-140089823955632_5d862a07-a296-4c72-811d-80f72df1799d/test-curl-7471-140089823955632/0.log"
Jul 09 13:05:27.743990 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.743954    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdq6s\" (UniqueName: \"kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s\") pod \"5d862a07-a296-4c72-811d-80f72df1799d\" (UID: \"5d862a07-a296-4c72-811d-80f72df1799d\") "
Jul 09 13:05:27.747313 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.747286    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s" (OuterVolumeSpecName: "kube-api-access-gdq6s") pod "5d862a07-a296-4c72-811d-80f72df1799d" (UID: "5d862a07-a296-4c72-811d-80f72df1799d"). InnerVolumeSpecName "kube-api-access-gdq6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:27.749331 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.749310    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7471-140089823955632"]
Jul 09 13:05:27.755672 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.755648    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7471-140089823955632"]
Jul 09 13:05:27.845705 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:27.845619    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdq6s\" (UniqueName: \"kubernetes.io/projected/5d862a07-a296-4c72-811d-80f72df1799d-kube-api-access-gdq6s\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:28.542315 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:28.542281    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6e25e961d36c0bd1957299db5fa1b454ef4417f1e404e2281b1e55c77b62644"
Jul 09 13:05:28.542315 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:28.542285    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:28.552870 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:28.552836    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7471-140089823955632\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="5d862a07-a296-4c72-811d-80f72df1799d" pod="openshift-ingress/test-curl-7471-140089823955632"
Jul 09 13:05:28.566801 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:28.566770    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d862a07-a296-4c72-811d-80f72df1799d" path="/var/lib/kubelet/pods/5d862a07-a296-4c72-811d-80f72df1799d/volumes"
Jul 09 13:05:31.125481 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.125447    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:31.125857 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.125840    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d862a07-a296-4c72-811d-80f72df1799d" containerName="test-curl-7471-140089823955632"
Jul 09 13:05:31.125857 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.125853    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d862a07-a296-4c72-811d-80f72df1799d" containerName="test-curl-7471-140089823955632"
Jul 09 13:05:31.125947 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.125936    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d862a07-a296-4c72-811d-80f72df1799d" containerName="test-curl-7471-140089823955632"
Jul 09 13:05:31.129255 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.129238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:31.132209 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.132191    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-7bp7g\""
Jul 09 13:05:31.136632 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.136571    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:31.178365 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.178338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hts5\" (UniqueName: \"kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5\") pod \"test-curl-7471-140089818441888\" (UID: \"4589fe45-59d8-495c-b918-288d5a66f388\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:31.279757 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.279731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hts5\" (UniqueName: \"kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5\") pod \"test-curl-7471-140089818441888\" (UID: \"4589fe45-59d8-495c-b918-288d5a66f388\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:31.288929 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.288909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hts5\" (UniqueName: \"kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5\") pod \"test-curl-7471-140089818441888\" (UID: \"4589fe45-59d8-495c-b918-288d5a66f388\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:31.439678 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.439599    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:31.577846 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:31.577824    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:31.580205 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:05:31.580173    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4589fe45_59d8_495c_b918_288d5a66f388.slice/crio-1c2207332aa01f0278983326b9af37c60290f346bf73e0bf38296a66f2939230 WatchSource:0}: Error finding container 1c2207332aa01f0278983326b9af37c60290f346bf73e0bf38296a66f2939230: Status 404 returned error can't find the container with id 1c2207332aa01f0278983326b9af37c60290f346bf73e0bf38296a66f2939230
Jul 09 13:05:32.567567 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:32.567457    2573 generic.go:356] "Generic (PLEG): container finished" podID="4589fe45-59d8-495c-b918-288d5a66f388" containerID="7d409265494bc2806737133d6d8a75de0ac276db07cace029bd337daf78db7bf" exitCode=0
Jul 09 13:05:32.568318 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:32.568292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818441888" event={"ID":"4589fe45-59d8-495c-b918-288d5a66f388","Type":"ContainerDied","Data":"7d409265494bc2806737133d6d8a75de0ac276db07cace029bd337daf78db7bf"}
Jul 09 13:05:32.568365 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:32.568331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818441888" event={"ID":"4589fe45-59d8-495c-b918-288d5a66f388","Type":"ContainerStarted","Data":"1c2207332aa01f0278983326b9af37c60290f346bf73e0bf38296a66f2939230"}
Jul 09 13:05:33.705783 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.705760    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:33.728603 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.728566    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7471-140089818441888_4589fe45-59d8-495c-b918-288d5a66f388/test-curl-7471-140089818441888/0.log"
Jul 09 13:05:33.754069 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.754038    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:33.757374 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.757352    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:33.804431 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.804408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hts5\" (UniqueName: \"kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5\") pod \"4589fe45-59d8-495c-b918-288d5a66f388\" (UID: \"4589fe45-59d8-495c-b918-288d5a66f388\") "
Jul 09 13:05:33.806363 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.806331    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5" (OuterVolumeSpecName: "kube-api-access-9hts5") pod "4589fe45-59d8-495c-b918-288d5a66f388" (UID: "4589fe45-59d8-495c-b918-288d5a66f388"). InnerVolumeSpecName "kube-api-access-9hts5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:33.877893 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.877827    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:33.878236 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.878223    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4589fe45-59d8-495c-b918-288d5a66f388" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:33.878282 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.878237    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4589fe45-59d8-495c-b918-288d5a66f388" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:33.878337 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.878328    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4589fe45-59d8-495c-b918-288d5a66f388" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:33.881590 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.881572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:33.888289 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.888264    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:33.905587 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:33.905566    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hts5\" (UniqueName: \"kubernetes.io/projected/4589fe45-59d8-495c-b918-288d5a66f388-kube-api-access-9hts5\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:34.006203 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.006173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dqk\" (UniqueName: \"kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk\") pod \"test-curl-7471-140089818441888\" (UID: \"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:34.107521 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.107477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dqk\" (UniqueName: \"kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk\") pod \"test-curl-7471-140089818441888\" (UID: \"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:34.118000 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.117966    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dqk\" (UniqueName: \"kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk\") pod \"test-curl-7471-140089818441888\" (UID: \"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c\") " pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:34.192107 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.192011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:34.330447 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.330422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:34.331788 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:05:34.331759    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dc84cae_46b1_4108_a2f4_52c49c3ccd5c.slice/crio-a4d7b4b9e5384e002eaa8881b535b98acdfaf0018353bb45c846e1e8579a6223 WatchSource:0}: Error finding container a4d7b4b9e5384e002eaa8881b535b98acdfaf0018353bb45c846e1e8579a6223: Status 404 returned error can't find the container with id a4d7b4b9e5384e002eaa8881b535b98acdfaf0018353bb45c846e1e8579a6223
Jul 09 13:05:34.568689 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.568656    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4589fe45-59d8-495c-b918-288d5a66f388" path="/var/lib/kubelet/pods/4589fe45-59d8-495c-b918-288d5a66f388/volumes"
Jul 09 13:05:34.580408 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.580384    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:34.580529 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.580428    2573 scope.go:117] "RemoveContainer" containerID="7d409265494bc2806737133d6d8a75de0ac276db07cace029bd337daf78db7bf"
Jul 09 13:05:34.581868 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:34.581832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818441888" event={"ID":"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c","Type":"ContainerStarted","Data":"a4d7b4b9e5384e002eaa8881b535b98acdfaf0018353bb45c846e1e8579a6223"}
Jul 09 13:05:35.588751 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:35.588718    2573 generic.go:356] "Generic (PLEG): container finished" podID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" containerID="cb111b32eaa5e0ca5154d5acee9132d99956e40d0b0ade08943059cdeecf2798" exitCode=0
Jul 09 13:05:35.589142 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:35.588811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818441888" event={"ID":"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c","Type":"ContainerDied","Data":"cb111b32eaa5e0ca5154d5acee9132d99956e40d0b0ade08943059cdeecf2798"}
Jul 09 13:05:36.728968 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.728947    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:36.752629 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.752603    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7471-140089818441888_5dc84cae-46b1-4108-a2f4-52c49c3ccd5c/test-curl-7471-140089818441888/0.log"
Jul 09 13:05:36.776825 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.776791    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:36.781773 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.781750    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7471-140089818441888"]
Jul 09 13:05:36.833963 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.833938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dqk\" (UniqueName: \"kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk\") pod \"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c\" (UID: \"5dc84cae-46b1-4108-a2f4-52c49c3ccd5c\") "
Jul 09 13:05:36.835913 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.835890    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk" (OuterVolumeSpecName: "kube-api-access-n2dqk") pod "5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" (UID: "5dc84cae-46b1-4108-a2f4-52c49c3ccd5c"). InnerVolumeSpecName "kube-api-access-n2dqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:36.935505 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.935415    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dqk\" (UniqueName: \"kubernetes.io/projected/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c-kube-api-access-n2dqk\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:36.935664 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.935644    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:36.936033 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.936020    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:36.936078 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.936035    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:36.936123 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.936112    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" containerName="test-curl-7471-140089818441888"
Jul 09 13:05:36.939168 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.939151    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:36.952854 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:36.952827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:37.036738 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.036703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqvpz\" (UniqueName: \"kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz\") pod \"test-curl-7471-140089818442896\" (UID: \"7a0686eb-25ef-4fba-91c5-daf2fb050eb4\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:37.137670 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.137628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqvpz\" (UniqueName: \"kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz\") pod \"test-curl-7471-140089818442896\" (UID: \"7a0686eb-25ef-4fba-91c5-daf2fb050eb4\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:37.148037 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.148009    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqvpz\" (UniqueName: \"kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz\") pod \"test-curl-7471-140089818442896\" (UID: \"7a0686eb-25ef-4fba-91c5-daf2fb050eb4\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:37.249001 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.248970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:37.379215 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.379181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:37.380569 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:05:37.380540    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a0686eb_25ef_4fba_91c5_daf2fb050eb4.slice/crio-245cf49a38e366781d440a1b3c800b649a823a7c39f03a08eeb4723242ae0c2c WatchSource:0}: Error finding container 245cf49a38e366781d440a1b3c800b649a823a7c39f03a08eeb4723242ae0c2c: Status 404 returned error can't find the container with id 245cf49a38e366781d440a1b3c800b649a823a7c39f03a08eeb4723242ae0c2c
Jul 09 13:05:37.602223 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.602141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818442896" event={"ID":"7a0686eb-25ef-4fba-91c5-daf2fb050eb4","Type":"ContainerStarted","Data":"245cf49a38e366781d440a1b3c800b649a823a7c39f03a08eeb4723242ae0c2c"}
Jul 09 13:05:37.603578 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.603557    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4d7b4b9e5384e002eaa8881b535b98acdfaf0018353bb45c846e1e8579a6223"
Jul 09 13:05:37.603700 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:37.603592    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:37.614455 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:37.614432    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7471-140089818441888\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:38.127710 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.127650    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" podUID="c74347a2-c813-44d6-8d42-af3aba9ce76a" containerName="main" containerID="cri-o://5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44" gracePeriod=45
Jul 09 13:05:38.383168 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.383111    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:05:38.386101 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:38.386072    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7471-140089818441888\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" pod="openshift-ingress/test-curl-7471-140089818441888"
Jul 09 13:05:38.448853 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.448818    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449049 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.448890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449049 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.448925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449049 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.448952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449049 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449023    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449254 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449052    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxzlc\" (UniqueName: \"kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc\") pod \"c74347a2-c813-44d6-8d42-af3aba9ce76a\" (UID: \"c74347a2-c813-44d6-8d42-af3aba9ce76a\") "
Jul 09 13:05:38.449254 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449189    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:05:38.449254 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449236    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home" (OuterVolumeSpecName: "home") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:05:38.449414 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449249    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:05:38.449474 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449431    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-model-cache\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.449474 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449450    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-home\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.449632 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.449481    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-tmp-dir\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.451281 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.451258    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm" (OuterVolumeSpecName: "dshm") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:05:38.451281 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.451261    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc" (OuterVolumeSpecName: "kube-api-access-hxzlc") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "kube-api-access-hxzlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:38.451407 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.451385    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c74347a2-c813-44d6-8d42-af3aba9ce76a" (UID: "c74347a2-c813-44d6-8d42-af3aba9ce76a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:05:38.550260 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.550223    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74347a2-c813-44d6-8d42-af3aba9ce76a-tls-certs\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.550260 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.550259    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74347a2-c813-44d6-8d42-af3aba9ce76a-dshm\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.550474 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.550269    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxzlc\" (UniqueName: \"kubernetes.io/projected/c74347a2-c813-44d6-8d42-af3aba9ce76a-kube-api-access-hxzlc\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:38.567172 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.567138    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dc84cae-46b1-4108-a2f4-52c49c3ccd5c" path="/var/lib/kubelet/pods/5dc84cae-46b1-4108-a2f4-52c49c3ccd5c/volumes"
Jul 09 13:05:38.610463 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.610430    2573 generic.go:356] "Generic (PLEG): container finished" podID="c74347a2-c813-44d6-8d42-af3aba9ce76a" containerID="5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44" exitCode=0
Jul 09 13:05:38.610648 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.610477    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"
Jul 09 13:05:38.610648 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.610536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" event={"ID":"c74347a2-c813-44d6-8d42-af3aba9ce76a","Type":"ContainerDied","Data":"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"}
Jul 09 13:05:38.610648 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.610576    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc" event={"ID":"c74347a2-c813-44d6-8d42-af3aba9ce76a","Type":"ContainerDied","Data":"442920fb507df44db8b36eaf19a0879f0411d31b8a431e93a105dab53ac7d190"}
Jul 09 13:05:38.610648 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.610599    2573 scope.go:117] "RemoveContainer" containerID="5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"
Jul 09 13:05:38.612289 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.612258    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a0686eb-25ef-4fba-91c5-daf2fb050eb4" containerID="5f171ec8293adada94003ca19fc2541d20c963e80b1b80470a63eda0240371c1" exitCode=0
Jul 09 13:05:38.612428 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.612330    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818442896" event={"ID":"7a0686eb-25ef-4fba-91c5-daf2fb050eb4","Type":"ContainerDied","Data":"5f171ec8293adada94003ca19fc2541d20c963e80b1b80470a63eda0240371c1"}
Jul 09 13:05:38.619532 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.619503    2573 scope.go:117] "RemoveContainer" containerID="5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"
Jul 09 13:05:38.619798 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:38.619777    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44\": container with ID starting with 5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44 not found: ID does not exist" containerID="5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"
Jul 09 13:05:38.619852 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.619806    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44"} err="failed to get container status \"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44\": rpc error: code = NotFound desc = could not find container \"5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44\": container with ID starting with 5925ce9edfef6a8056b3189c2f9fe9450295542b969a0fe8ffd2c332201d9d44 not found: ID does not exist"
Jul 09 13:05:38.649449 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.649354    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:05:38.654135 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:38.654103    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5cca2/rate-test-model-d5cca2-kserve-6fcdf966c5-5wzcc"]
Jul 09 13:05:39.786223 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.786193    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:39.807360 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.807337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7471-140089818442896_7a0686eb-25ef-4fba-91c5-daf2fb050eb4/test-curl-7471-140089818442896/0.log"
Jul 09 13:05:39.831078 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.831051    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:39.834705 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.834680    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:39.862350 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.862307    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqvpz\" (UniqueName: \"kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz\") pod \"7a0686eb-25ef-4fba-91c5-daf2fb050eb4\" (UID: \"7a0686eb-25ef-4fba-91c5-daf2fb050eb4\") "
Jul 09 13:05:39.864300 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.864276    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz" (OuterVolumeSpecName: "kube-api-access-qqvpz") pod "7a0686eb-25ef-4fba-91c5-daf2fb050eb4" (UID: "7a0686eb-25ef-4fba-91c5-daf2fb050eb4"). InnerVolumeSpecName "kube-api-access-qqvpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:39.961873 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.961823    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:39.962275 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962260    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0686eb-25ef-4fba-91c5-daf2fb050eb4" containerName="test-curl-7471-140089818442896"
Jul 09 13:05:39.962318 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0686eb-25ef-4fba-91c5-daf2fb050eb4" containerName="test-curl-7471-140089818442896"
Jul 09 13:05:39.962318 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962297    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74347a2-c813-44d6-8d42-af3aba9ce76a" containerName="main"
Jul 09 13:05:39.962318 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962303    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74347a2-c813-44d6-8d42-af3aba9ce76a" containerName="main"
Jul 09 13:05:39.962404 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962371    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0686eb-25ef-4fba-91c5-daf2fb050eb4" containerName="test-curl-7471-140089818442896"
Jul 09 13:05:39.962404 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.962381    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74347a2-c813-44d6-8d42-af3aba9ce76a" containerName="main"
Jul 09 13:05:39.963760 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.963732    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqvpz\" (UniqueName: \"kubernetes.io/projected/7a0686eb-25ef-4fba-91c5-daf2fb050eb4-kube-api-access-qqvpz\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:39.965486 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.965471    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:39.973123 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:39.973070    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:40.064888 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.064845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcjzj\" (UniqueName: \"kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj\") pod \"test-curl-7471-140089818442896\" (UID: \"26cff16b-310d-4a7a-8b32-6304aa3adf20\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:40.166137 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.166057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcjzj\" (UniqueName: \"kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj\") pod \"test-curl-7471-140089818442896\" (UID: \"26cff16b-310d-4a7a-8b32-6304aa3adf20\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:40.174934 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.174903    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcjzj\" (UniqueName: \"kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj\") pod \"test-curl-7471-140089818442896\" (UID: \"26cff16b-310d-4a7a-8b32-6304aa3adf20\") " pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:40.276559 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.276527    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:40.412566 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.412540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:40.413977 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:05:40.413948    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26cff16b_310d_4a7a_8b32_6304aa3adf20.slice/crio-a58b298c488eb211a339e90033fe6a3be023a5a73deac6b1ad23a2fb15160c0a WatchSource:0}: Error finding container a58b298c488eb211a339e90033fe6a3be023a5a73deac6b1ad23a2fb15160c0a: Status 404 returned error can't find the container with id a58b298c488eb211a339e90033fe6a3be023a5a73deac6b1ad23a2fb15160c0a
Jul 09 13:05:40.567698 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.567631    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0686eb-25ef-4fba-91c5-daf2fb050eb4" path="/var/lib/kubelet/pods/7a0686eb-25ef-4fba-91c5-daf2fb050eb4/volumes"
Jul 09 13:05:40.568078 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.568065    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74347a2-c813-44d6-8d42-af3aba9ce76a" path="/var/lib/kubelet/pods/c74347a2-c813-44d6-8d42-af3aba9ce76a/volumes"
Jul 09 13:05:40.626780 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.626735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818442896" event={"ID":"26cff16b-310d-4a7a-8b32-6304aa3adf20","Type":"ContainerStarted","Data":"a58b298c488eb211a339e90033fe6a3be023a5a73deac6b1ad23a2fb15160c0a"}
Jul 09 13:05:40.628029 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.628009    2573 scope.go:117] "RemoveContainer" containerID="5f171ec8293adada94003ca19fc2541d20c963e80b1b80470a63eda0240371c1"
Jul 09 13:05:40.628135 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:40.628015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:41.634501 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:41.634465    2573 generic.go:356] "Generic (PLEG): container finished" podID="26cff16b-310d-4a7a-8b32-6304aa3adf20" containerID="9429aff6e07ee343b7c350022296f091ac203e8026b2fa45164e17c4a9029a67" exitCode=0
Jul 09 13:05:41.634952 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:41.634558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7471-140089818442896" event={"ID":"26cff16b-310d-4a7a-8b32-6304aa3adf20","Type":"ContainerDied","Data":"9429aff6e07ee343b7c350022296f091ac203e8026b2fa45164e17c4a9029a67"}
Jul 09 13:05:42.778682 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.778656    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:42.804881 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.804857    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7471-140089818442896_26cff16b-310d-4a7a-8b32-6304aa3adf20/test-curl-7471-140089818442896/0.log"
Jul 09 13:05:42.835766 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.835735    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:42.839948 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.839927    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7471-140089818442896"]
Jul 09 13:05:42.890886 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.890863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcjzj\" (UniqueName: \"kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj\") pod \"26cff16b-310d-4a7a-8b32-6304aa3adf20\" (UID: \"26cff16b-310d-4a7a-8b32-6304aa3adf20\") "
Jul 09 13:05:42.892907 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.892855    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj" (OuterVolumeSpecName: "kube-api-access-rcjzj") pod "26cff16b-310d-4a7a-8b32-6304aa3adf20" (UID: "26cff16b-310d-4a7a-8b32-6304aa3adf20"). InnerVolumeSpecName "kube-api-access-rcjzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:05:42.992178 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:42.992132    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcjzj\" (UniqueName: \"kubernetes.io/projected/26cff16b-310d-4a7a-8b32-6304aa3adf20-kube-api-access-rcjzj\") on node \"ip-10-0-140-238.ec2.internal\" DevicePath \"\""
Jul 09 13:05:43.647713 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:43.647684    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:43.647868 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:43.647728    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a58b298c488eb211a339e90033fe6a3be023a5a73deac6b1ad23a2fb15160c0a"
Jul 09 13:05:43.658142 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:43.658112    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7471-140089818442896\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:44.566122 ip-10-0-140-238 kubenswrapper[2573]: E0709 13:05:44.566084    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7471-140089818442896\" is forbidden: User \"system:node:ip-10-0-140-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-238.ec2.internal' and this object" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" pod="openshift-ingress/test-curl-7471-140089818442896"
Jul 09 13:05:44.568257 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:05:44.568235    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" path="/var/lib/kubelet/pods/26cff16b-310d-4a7a-8b32-6304aa3adf20/volumes"
Jul 09 13:06:03.647868 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:03.647834    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fdc6f7f5d-dmdsg_947a6dd3-bee2-43a2-b857-a6fcabcded2e/manager/0.log"
Jul 09 13:06:04.018044 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:04.018012    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578cb9c586-f49dj_7f8eb546-2f1a-4285-9cbf-2568ac57e2cf/copy-manifests/0.log"
Jul 09 13:06:04.025203 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:04.025174    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578cb9c586-f49dj_7f8eb546-2f1a-4285-9cbf-2568ac57e2cf/manager/0.log"
Jul 09 13:06:05.613152 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.613120    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/pull/0.log"
Jul 09 13:06:05.619231 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.619213    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/extract/0.log"
Jul 09 13:06:05.625490 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.625467    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/util/0.log"
Jul 09 13:06:05.742184 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.742155    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/util/0.log"
Jul 09 13:06:05.749681 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.749658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/pull/0.log"
Jul 09 13:06:05.756564 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.756541    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/extract/0.log"
Jul 09 13:06:05.873557 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.873466    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/util/0.log"
Jul 09 13:06:05.879882 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.879857    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/pull/0.log"
Jul 09 13:06:05.885462 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.885442    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/extract/0.log"
Jul 09 13:06:05.996245 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:05.996218    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/util/0.log"
Jul 09 13:06:06.003025 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:06.003003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/pull/0.log"
Jul 09 13:06:06.008915 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:06.008895    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/extract/0.log"
Jul 09 13:06:06.478467 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:06.478440    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4hx7x_49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd/kuadrant-console-plugin/0.log"
Jul 09 13:06:06.733136 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:06.733056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l9qr2_4dc47044-3429-410a-bc73-b5541ffe5b05/manager/0.log"
Jul 09 13:06:07.620796 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:07.620770    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7776979d9-867vl_adb1e00f-bfe3-43f5-a883-5e21a99cab6f/kube-auth-proxy/0.log"
Jul 09 13:06:08.004002 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:08.003960    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-f24fs_f5bbed0d-c21b-423c-beb3-902662029af3/payload-pre-processing/0.log"
Jul 09 13:06:08.130046 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:08.130017    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-65vhk_27b6b789-70fd-4dc1-8c81-4add6a6dfb2f/payload-processing/0.log"
Jul 09 13:06:08.745877 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:08.745848    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x5wlr_0245b594-f4c2-40b2-b9bd-3910c780d27c/main/0.log"
Jul 09 13:06:09.112244 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:09.112160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-55676_58d580f6-78aa-474a-ba3e-6667ed8fde99/main/0.log"
Jul 09 13:06:09.224881 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:09.224855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-jvvn4_5dd0c1f3-c5da-4c87-9b6e-e6a3eb2e4547/main/0.log"
Jul 09 13:06:16.720333 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:16.720300    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9gx2x_e8124b40-5d3d-4991-af45-c26d424c1b56/global-pull-secret-syncer/0.log"
Jul 09 13:06:16.893308 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:16.893276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mh4lj_bbbd15d1-a308-486e-93ef-0498c4901846/konnectivity-agent/0.log"
Jul 09 13:06:16.975418 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:16.975331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-238.ec2.internal_069146ecd5862847c6bad18c20b767ba/haproxy/0.log"
Jul 09 13:06:21.815394 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.815369    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/extract/0.log"
Jul 09 13:06:21.843259 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.843237    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/util/0.log"
Jul 09 13:06:21.865380 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.865352    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lqv4w_1aef0400-0af4-4012-b023-137febcdf604/pull/0.log"
Jul 09 13:06:21.911162 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.911138    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/extract/0.log"
Jul 09 13:06:21.933414 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.933390    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/util/0.log"
Jul 09 13:06:21.958288 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.958272    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s662n_ccb4244c-d474-480d-bdcb-707747d96209/pull/0.log"
Jul 09 13:06:21.988997 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:21.988971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/extract/0.log"
Jul 09 13:06:22.012706 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.012679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/util/0.log"
Jul 09 13:06:22.039219 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.039193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736846b_afc6ec06-42d2-479f-a894-3811118e898c/pull/0.log"
Jul 09 13:06:22.071136 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.071071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/extract/0.log"
Jul 09 13:06:22.097104 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.097083    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/util/0.log"
Jul 09 13:06:22.121487 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.121465    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st6cs_02f9430c-991b-475f-9fda-f1cf72403611/pull/0.log"
Jul 09 13:06:22.639008 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.638983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4hx7x_49b78c8b-2dce-4bcf-9ca1-2db6411a0dfd/kuadrant-console-plugin/0.log"
Jul 09 13:06:22.796428 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:22.796390    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l9qr2_4dc47044-3429-410a-bc73-b5541ffe5b05/manager/0.log"
Jul 09 13:06:24.651713 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.651681    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/alertmanager/0.log"
Jul 09 13:06:24.678042 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.678022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/config-reloader/0.log"
Jul 09 13:06:24.705171 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.705143    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/kube-rbac-proxy-web/0.log"
Jul 09 13:06:24.755463 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.755436    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/kube-rbac-proxy/0.log"
Jul 09 13:06:24.801410 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.801327    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/kube-rbac-proxy-metric/0.log"
Jul 09 13:06:24.845888 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.845864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/prom-label-proxy/0.log"
Jul 09 13:06:24.878336 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.878307    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2656704e-a45a-4cc2-99f9-b94dd9564b09/init-config-reloader/0.log"
Jul 09 13:06:24.949226 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.949197    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lqpzv_4b530201-8e00-4bb4-bfa6-655ee0c7f1cc/kube-state-metrics/0.log"
Jul 09 13:06:24.974206 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.974185    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lqpzv_4b530201-8e00-4bb4-bfa6-655ee0c7f1cc/kube-rbac-proxy-main/0.log"
Jul 09 13:06:24.997387 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:24.997367    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lqpzv_4b530201-8e00-4bb4-bfa6-655ee0c7f1cc/kube-rbac-proxy-self/0.log"
Jul 09 13:06:25.027173 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.027142    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bbffc4658-4869l_cb7631e9-a5bf-4e43-83c8-8ef24474df6d/metrics-server/0.log"
Jul 09 13:06:25.054449 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.054380    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-cgb7w_9f68c11d-2633-4531-ad81-9f9205ed0b62/monitoring-plugin/0.log"
Jul 09 13:06:25.250543 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.250503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rx88j_39f6252d-a086-4737-a710-9cd7f255453b/node-exporter/0.log"
Jul 09 13:06:25.272533 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.272480    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rx88j_39f6252d-a086-4737-a710-9cd7f255453b/kube-rbac-proxy/0.log"
Jul 09 13:06:25.295465 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.295442    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rx88j_39f6252d-a086-4737-a710-9cd7f255453b/init-textfile/0.log"
Jul 09 13:06:25.322623 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.322537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-nzmxz_9a18b0a1-84ca-4fa6-a522-14264b55d36f/kube-rbac-proxy-main/0.log"
Jul 09 13:06:25.345347 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.345319    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-nzmxz_9a18b0a1-84ca-4fa6-a522-14264b55d36f/kube-rbac-proxy-self/0.log"
Jul 09 13:06:25.367552 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.367523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-nzmxz_9a18b0a1-84ca-4fa6-a522-14264b55d36f/openshift-state-metrics/0.log"
Jul 09 13:06:25.408535 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.408487    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/prometheus/0.log"
Jul 09 13:06:25.433691 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.433663    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/config-reloader/0.log"
Jul 09 13:06:25.456712 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.456679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/thanos-sidecar/0.log"
Jul 09 13:06:25.481800 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.481778    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/kube-rbac-proxy-web/0.log"
Jul 09 13:06:25.506871 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.506843    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/kube-rbac-proxy/0.log"
Jul 09 13:06:25.530128 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.530102    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/kube-rbac-proxy-thanos/0.log"
Jul 09 13:06:25.555032 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.555006    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_582d2a3f-2ede-4dc3-8666-692c37035063/init-config-reloader/0.log"
Jul 09 13:06:25.665126 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.665044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d654b4c8-wb4km_3182aba6-b776-4b6f-b482-23c838c15ec6/telemeter-client/0.log"
Jul 09 13:06:25.687219 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.687193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d654b4c8-wb4km_3182aba6-b776-4b6f-b482-23c838c15ec6/reload/0.log"
Jul 09 13:06:25.708877 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.708846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d654b4c8-wb4km_3182aba6-b776-4b6f-b482-23c838c15ec6/kube-rbac-proxy/0.log"
Jul 09 13:06:25.741550 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.741523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/thanos-query/0.log"
Jul 09 13:06:25.763439 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.763414    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/kube-rbac-proxy-web/0.log"
Jul 09 13:06:25.785622 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.785593    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/kube-rbac-proxy/0.log"
Jul 09 13:06:25.808378 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.808350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/prom-label-proxy/0.log"
Jul 09 13:06:25.833106 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.833086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/kube-rbac-proxy-rules/0.log"
Jul 09 13:06:25.870030 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:25.870006    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b956c689-6ptbr_29b90e6f-2328-42c9-87c2-c83d90c646fd/kube-rbac-proxy-metrics/0.log"
Jul 09 13:06:27.164716 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.164683    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"]
Jul 09 13:06:27.165116 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.165079    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" containerName="test-curl-7471-140089818442896"
Jul 09 13:06:27.165116 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.165090    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" containerName="test-curl-7471-140089818442896"
Jul 09 13:06:27.165206 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.165158    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="26cff16b-310d-4a7a-8b32-6304aa3adf20" containerName="test-curl-7471-140089818442896"
Jul 09 13:06:27.168257 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.168241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.170889 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.170869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh67t\"/\"kube-root-ca.crt\""
Jul 09 13:06:27.172282 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.172180    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh67t\"/\"default-dockercfg-kf9n4\""
Jul 09 13:06:27.172282 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.172240    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh67t\"/\"openshift-service-ca.crt\""
Jul 09 13:06:27.177875 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.177854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"]
Jul 09 13:06:27.316753 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.316712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-sys\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.316753 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.316751    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24l4n\" (UniqueName: \"kubernetes.io/projected/e862c851-4ee1-450e-9a37-0290c31b51e2-kube-api-access-24l4n\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.316963 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.316824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-proc\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.316963 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.316845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-podres\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.316963 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.316923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-lib-modules\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418364 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-proc\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418364 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-podres\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-lib-modules\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418406    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-proc\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-sys\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24l4n\" (UniqueName: \"kubernetes.io/projected/e862c851-4ee1-450e-9a37-0290c31b51e2-kube-api-access-24l4n\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418467    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-sys\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418544    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-podres\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.418599 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.418575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e862c851-4ee1-450e-9a37-0290c31b51e2-lib-modules\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.427521 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.427493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24l4n\" (UniqueName: \"kubernetes.io/projected/e862c851-4ee1-450e-9a37-0290c31b51e2-kube-api-access-24l4n\") pod \"perf-node-gather-daemonset-rhch6\" (UID: \"e862c851-4ee1-450e-9a37-0290c31b51e2\") " pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.479471 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.479447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.612876 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.612845    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"]
Jul 09 13:06:27.614063 ip-10-0-140-238 kubenswrapper[2573]: W0709 13:06:27.614026    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode862c851_4ee1_450e_9a37_0290c31b51e2.slice/crio-b879503407580d0ee4d282b6cc2e2abb8d6a6839533f579998878e4fe8ee887e WatchSource:0}: Error finding container b879503407580d0ee4d282b6cc2e2abb8d6a6839533f579998878e4fe8ee887e: Status 404 returned error can't find the container with id b879503407580d0ee4d282b6cc2e2abb8d6a6839533f579998878e4fe8ee887e
Jul 09 13:06:27.896210 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.896179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6" event={"ID":"e862c851-4ee1-450e-9a37-0290c31b51e2","Type":"ContainerStarted","Data":"20fae7e106e20a83459886e95289ccb464df147b8c50c481dee08a15a21c0d05"}
Jul 09 13:06:27.896403 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.896233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6" event={"ID":"e862c851-4ee1-450e-9a37-0290c31b51e2","Type":"ContainerStarted","Data":"b879503407580d0ee4d282b6cc2e2abb8d6a6839533f579998878e4fe8ee887e"}
Jul 09 13:06:27.896403 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.896317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:27.914665 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:27.914616    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6" podStartSLOduration=0.914600387 podStartE2EDuration="914.600387ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:06:27.913571442 +0000 UTC m=+2503.904702592" watchObservedRunningTime="2026-07-09 13:06:27.914600387 +0000 UTC m=+2503.905731550"
Jul 09 13:06:30.148326 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:30.148297    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sg6zn_f8386d01-a467-4d43-be40-7799fd8963ae/dns/0.log"
Jul 09 13:06:30.169356 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:30.169328    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sg6zn_f8386d01-a467-4d43-be40-7799fd8963ae/kube-rbac-proxy/0.log"
Jul 09 13:06:30.247219 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:30.247179    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2td8_eb788023-e540-4a1c-8a0a-f6813750d2b2/dns-node-resolver/0.log"
Jul 09 13:06:30.871692 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:30.871664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pgxd8_c3875233-eb34-488c-995f-cd86e207b680/node-ca/0.log"
Jul 09 13:06:32.051876 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:32.051847    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7776979d9-867vl_adb1e00f-bfe3-43f5-a883-5e21a99cab6f/kube-auth-proxy/0.log"
Jul 09 13:06:32.198479 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:32.198438    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-f24fs_f5bbed0d-c21b-423c-beb3-902662029af3/payload-pre-processing/0.log"
Jul 09 13:06:32.245324 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:32.245295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-65vhk_27b6b789-70fd-4dc1-8c81-4add6a6dfb2f/payload-processing/0.log"
Jul 09 13:06:32.976236 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:32.976197    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rxmpq_b29d99c7-4da1-49da-98f0-6d45d077c2bd/serve-healthcheck-canary/0.log"
Jul 09 13:06:33.698149 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:33.698115    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpx2k_08454f94-58ee-4ce2-a561-ad7b501a1919/kube-rbac-proxy/0.log"
Jul 09 13:06:33.721789 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:33.721755    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpx2k_08454f94-58ee-4ce2-a561-ad7b501a1919/exporter/0.log"
Jul 09 13:06:33.744919 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:33.744897    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpx2k_08454f94-58ee-4ce2-a561-ad7b501a1919/extractor/0.log"
Jul 09 13:06:33.912468 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:33.912436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh67t/perf-node-gather-daemonset-rhch6"
Jul 09 13:06:36.371212 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:36.371179    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fdc6f7f5d-dmdsg_947a6dd3-bee2-43a2-b857-a6fcabcded2e/manager/0.log"
Jul 09 13:06:36.553929 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:36.553901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578cb9c586-f49dj_7f8eb546-2f1a-4285-9cbf-2568ac57e2cf/manager/0.log"
Jul 09 13:06:36.575822 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:36.575788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578cb9c586-f49dj_7f8eb546-2f1a-4285-9cbf-2568ac57e2cf/copy-manifests/0.log"
Jul 09 13:06:37.563326 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:37.563293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7776979d9-867vl_adb1e00f-bfe3-43f5-a883-5e21a99cab6f/kube-auth-proxy/0.log"
Jul 09 13:06:37.668812 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:37.668735    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-f24fs_f5bbed0d-c21b-423c-beb3-902662029af3/payload-pre-processing/0.log"
Jul 09 13:06:37.706231 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:37.706202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-65vhk_27b6b789-70fd-4dc1-8c81-4add6a6dfb2f/payload-processing/0.log"
Jul 09 13:06:38.124116 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:38.124087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5467b45f76-zfct9_805d420d-4017-4f7c-9ad4-b5fbaa2c6ac5/manager/0.log"
Jul 09 13:06:39.090766 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:39.090735    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7776979d9-867vl_adb1e00f-bfe3-43f5-a883-5e21a99cab6f/kube-auth-proxy/0.log"
Jul 09 13:06:39.214319 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:39.214243    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-f24fs_f5bbed0d-c21b-423c-beb3-902662029af3/payload-pre-processing/0.log"
Jul 09 13:06:39.251613 ip-10-0-140-238 kubenswrapper[2573]: I0709 13:06:39.251581    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-65vhk_27b6b789-70fd-4dc1-8c81-4add6a6dfb2f/payload-processing/0.log"