May 28 20:49:57.277341 ip-10-0-133-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 20:49:57.277357 ip-10-0-133-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 20:49:57.277367 ip-10-0-133-41 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 20:49:57.277688 ip-10-0-133-41 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 20:50:07.496055 ip-10-0-133-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 20:50:07.496079 ip-10-0-133-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a8e80052a0eb4afeb5051b7317cba275 --
May 28 20:52:34.210021 ip-10-0-133-41 systemd[1]: Starting Kubernetes Kubelet...
May 28 20:52:34.637562 ip-10-0-133-41 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 20:52:34.637562 ip-10-0-133-41 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 20:52:34.637562 ip-10-0-133-41 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 20:52:34.637562 ip-10-0-133-41 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 20:52:34.637562 ip-10-0-133-41 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 20:52:34.638292 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.638208    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 20:52:34.643901 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643886    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643902    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643906    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643910    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643913    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643916    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643919    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643921    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643924    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643926    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643929    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643932    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643934    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643937    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643939    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643942    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643944    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 20:52:34.643940 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643947    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643950    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643953    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643955    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643958    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643960    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643964    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643966    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643969    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643972    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643974    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643977    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643979    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643982    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643984    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643987    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643989    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643992    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643994    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643997    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 20:52:34.644349 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.643999    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644001    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644004    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644006    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644008    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644011    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644014    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644018    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644021    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644024    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644027    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644030    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644032    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644035    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644038    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644041    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644043    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644046    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644048    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644051    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 20:52:34.644896 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644053    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644056    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644058    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644060    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644063    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644065    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644068    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644070    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644072    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644075    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644077    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644079    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644082    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644084    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644087    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644090    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644092    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644095    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644099    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 20:52:34.645392 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644103    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644105    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644108    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644110    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644113    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644115    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644117    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644121    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644123    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644126    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644483    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644487    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644490    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644493    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644496    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644498    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644501    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644503    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644506    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644509    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 20:52:34.645855 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644511    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644514    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644517    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644519    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644522    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644524    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644527    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644530    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644533    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644535    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644538    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644540    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644543    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644545    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644548    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644550    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644553    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644555    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644558    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644561    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 20:52:34.646332 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644564    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644566    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644571    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644574    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644577    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644579    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644582    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644585    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644589    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644593    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644596    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644598    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644601    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644604    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644606    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644608    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644611    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644613    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644616    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 20:52:34.646833 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644618    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644621    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644624    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644626    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644628    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644631    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644633    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644636    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644638    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644641    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644643    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644645    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644649    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644652    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644655    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644657    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644660    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644662    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644665    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644668    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 20:52:34.647289 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644670    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644673    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644675    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644678    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644680    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644683    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644685    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644687    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644690    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644692    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644695    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644697    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644699    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644702    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644704    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644710    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.644712    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646262    2562 flags.go:64] FLAG: --address="0.0.0.0"
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646272    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646278    2562 flags.go:64] FLAG: --anonymous-auth="true"
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646283    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 20:52:34.647794 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646287    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646290    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646294    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646299    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646303    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646306    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646309    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646312    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646315    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646318    2562 flags.go:64] FLAG: --cgroup-root=""
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646321    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646324    2562 flags.go:64] FLAG: --client-ca-file=""
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646326    2562 flags.go:64] FLAG: --cloud-config=""
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646329    2562 flags.go:64] FLAG: --cloud-provider="external"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646332    2562 flags.go:64] FLAG: --cluster-dns="[]"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646337    2562 flags.go:64] FLAG: --cluster-domain=""
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646341    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646344    2562 flags.go:64] FLAG: --config-dir=""
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646347    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646350    2562 flags.go:64] FLAG: --container-log-max-files="5"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646354    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646357    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646360    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646363    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 20:52:34.648290 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646366    2562 flags.go:64] FLAG: --contention-profiling="false"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646369    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646372    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646376    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646379    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646384    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646387    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646390    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646393    2562 flags.go:64] FLAG: --enable-load-reader="false"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646395    2562 flags.go:64] FLAG: --enable-server="true"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646398    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646403    2562 flags.go:64] FLAG: --event-burst="100"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646406    2562 flags.go:64] FLAG: --event-qps="50"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646409    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646412    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646414    2562 flags.go:64] FLAG: --eviction-hard=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646418    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646421    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646424    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646427    2562 flags.go:64] FLAG: --eviction-soft=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646429    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646432    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646435    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646438    2562 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646441    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646443    2562 flags.go:64] FLAG: --fail-swap-on="true"
May 28 20:52:34.648893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646446    2562 flags.go:64] FLAG: --feature-gates=""
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646450    2562 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646453    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646456    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646459    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646461    2562 flags.go:64] FLAG: --healthz-port="10248"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646464    2562 flags.go:64] FLAG: --help="false"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646467    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-41.ec2.internal"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646470    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646473    2562 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646476    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646480    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646483    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646486    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646489    2562 flags.go:64] FLAG: --image-service-endpoint=""
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646491    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646494    2562 flags.go:64] FLAG: --kube-api-burst="100"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646497    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646500    2562 flags.go:64] FLAG: --kube-api-qps="50"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646503    2562 flags.go:64] FLAG: --kube-reserved=""
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646506    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646508    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646511    2562 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646514    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 20:52:34.649524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646517    2562 flags.go:64] FLAG: --lock-file=""
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646520    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646522    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646525    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646530    2562 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646533    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646536    2562 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646539    2562 flags.go:64] FLAG: --logging-format="text"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646541    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646545    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646548    2562 flags.go:64] FLAG: --manifest-url=""
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646550    2562 flags.go:64] FLAG: --manifest-url-header=""
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646554    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646557    2562 flags.go:64] FLAG: --max-open-files="1000000"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646561    2562 flags.go:64] FLAG: --max-pods="110"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646564    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646567    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646570    2562 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646573    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646576    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646579    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646582    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646589    2562 flags.go:64] FLAG: --node-status-max-images="50"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646592    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646596    2562 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 20:52:34.650134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646600    2562 flags.go:64] FLAG: --pod-cidr=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646602    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646608    2562 flags.go:64] FLAG: --pod-manifest-path=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646611    2562 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646614    2562 flags.go:64] FLAG: --pods-per-core="0"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646617    2562 flags.go:64] FLAG: --port="10250"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646619    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646622    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab7941d60c26d7db"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646625    2562 flags.go:64] FLAG: --qos-reserved=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646628    2562 flags.go:64] FLAG: --read-only-port="10255"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646631    2562 flags.go:64] FLAG: --register-node="true"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646634    2562 flags.go:64] FLAG: --register-schedulable="true"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646637    2562 flags.go:64] FLAG: --register-with-taints=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646645    2562 flags.go:64] FLAG: --registry-burst="10"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646648    2562 flags.go:64] FLAG: --registry-qps="5"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646650    2562 flags.go:64] FLAG: --reserved-cpus=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646653    2562 flags.go:64] FLAG: --reserved-memory=""
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646657    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646659    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646662    2562 flags.go:64] FLAG: --rotate-certificates="false"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646665    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646668    2562 flags.go:64] FLAG: --runonce="false"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646671    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646674    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646677    2562 flags.go:64] FLAG: --seccomp-default="false"
May 28 20:52:34.650717 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646680    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646683    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646687    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646690    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646693    2562 flags.go:64] FLAG: --storage-driver-password="root"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646695    2562 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646698    2562 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646701    2562 flags.go:64] FLAG: --storage-driver-user="root"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646704    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646707    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646710    2562 flags.go:64] FLAG: --system-cgroups=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646712    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646717    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646720    2562 flags.go:64] FLAG: --tls-cert-file=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646723    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646727    2562 flags.go:64] FLAG: --tls-min-version=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646730    2562 flags.go:64] FLAG: --tls-private-key-file=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646734    2562 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646736    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646739    2562 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646742    2562 flags.go:64] FLAG: --v="2"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646757    2562 flags.go:64] FLAG: --version="false"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646761    2562 flags.go:64] FLAG: --vmodule=""
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646765    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.646768    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 20:52:34.651363 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646859    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646865    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646869    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646872    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646875    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646878    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646881    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646883    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646886    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646889    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646892    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646895    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646897    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646900    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646902    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646905    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646907    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646910    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646913    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646915    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 20:52:34.651971 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646918    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646920    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646922    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646925    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646927    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646930    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646932    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646934    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646937    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646940    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646942    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646945    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646947    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646950    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646952    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646955    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646959    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646962    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646964    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646967    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 20:52:34.652477 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646969    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646972    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646974    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646984    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646986    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646989    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646991    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646994    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646996    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.646999    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647001    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647004    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647006    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647009    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647011    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647013    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647016    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647018    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647020    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647023    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 20:52:34.652975 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647025    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647028    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647030    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647032    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647035    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647037    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647040    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647042    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647049    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647051    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647054    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647056    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647058    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647060    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647063    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647070    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647081    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647084    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647087    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647089    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 20:52:34.653479 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647092    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647096    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647099    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647102    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.647104    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 20:52:34.653986 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.647767    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.654996    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.655012    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655058    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655063    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655066    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655070    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655072    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655075    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655077    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655081    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655084    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655086    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655089    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655091    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655094    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655097    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655099    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655102    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655105    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 20:52:34.655171 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655108    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655111    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655114    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655116    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655118    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655121    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655126    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655130    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655133    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655136    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655138    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655141    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655143    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655146    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655150    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655152    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655155    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655158    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655160    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655163    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 20:52:34.655692 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655166    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655169    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655173    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655176    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655179    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655182    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655185    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655187    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655190    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655192    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655195    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655197    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655200    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655202    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655205    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655207    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655210    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655212    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655215    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655217    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 20:52:34.656211 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655220    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655222    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655225    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655227    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655229    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655231    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655235    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655238    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655241    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655243    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655246    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655248    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655251    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655253    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655255    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655258    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655260    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655262    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655265    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655267    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 20:52:34.656700 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655269    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655272    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655274    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655277    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655279    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655281    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655284    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655286    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655289    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.655294    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655387    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655392    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655395    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655398    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655400    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 20:52:34.657212 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655403    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655406    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655408    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655411    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655414    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655417    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655419    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655422    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655424    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655427    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655429    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655433    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655436    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655439    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655443    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655446    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655448    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655451    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655454    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 20:52:34.657581 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655456    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655459    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655461    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655464    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655467    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655469    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655471    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655474    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655477    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655479    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655481    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655484    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655486    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655489    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655491    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655493    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655496    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655500    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655502    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655505    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 20:52:34.658053 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655508    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655510    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655513    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655515    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655518    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655520    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655522    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655525    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655527    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655529    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655532    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655534    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655537    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655539    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655541    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655544    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655546    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655549    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655551    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655553    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 20:52:34.658566 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655556    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655558    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655561    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655563    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655566    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655568    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655571    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655573    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655575    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655578    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655580    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655583    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655585    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655588    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655590    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655593    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655595    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655597    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655600    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655603    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 20:52:34.659095 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655606    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:34.655608    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.655613    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.656218    2562 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.658434    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.659318    2562 server.go:1019] "Starting client certificate rotation"
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.659419    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 20:52:34.659603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.659455    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 20:52:34.682129 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.682104    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 20:52:34.683902 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.683886    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 20:52:34.707843 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.707821    2562 log.go:25] "Validated CRI v1 runtime API"
May 28 20:52:34.713019 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.713003    2562 log.go:25] "Validated CRI v1 image API"
May 28 20:52:34.714381 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.714367    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 20:52:34.717833 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.717814    2562 fs.go:135] Filesystem UUIDs: map[283300e7-6a65-4163-bee4-51675a954da3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8213eabc-0ef2-4c4b-86e7-c0ad9d3332ff:/dev/nvme0n1p3]
May 28 20:52:34.717896 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.717833    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 20:52:34.722412 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.722303    2562 manager.go:217] Machine: {Timestamp:2026-05-28 20:52:34.721806599 +0000 UTC m=+0.399510012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112668 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d195312c097474e2ef41a59db9179 SystemUUID:ec2d1953-12c0-9747-4e2e-f41a59db9179 BootID:a8e80052-a0eb-4afe-b505-1b7317cba275 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:4b:3d:7f:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:4b:3d:7f:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:09:ad:ee:bf:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 20:52:34.723110 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.723099    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 20:52:34.723215 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.723196    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 20:52:34.723346 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.723332    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 20:52:34.725172 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.725146    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 20:52:34.725295 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.725173    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 20:52:34.725340 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.725305    2562 topology_manager.go:138] "Creating topology manager with none policy"
May 28 20:52:34.725340 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.725313    2562 container_manager_linux.go:306] "Creating device plugin manager"
May 28 20:52:34.725340 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.725320    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 20:52:34.726085 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.726074    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 20:52:34.727151 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.727142    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 20:52:34.727410 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.727400    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 20:52:34.729788 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.729779    2562 kubelet.go:491] "Attempting to sync node with API server"
May 28 20:52:34.729826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.729796    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 20:52:34.729826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.729809    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 20:52:34.729826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.729817    2562 kubelet.go:397] "Adding apiserver pod source"
May 28 20:52:34.729826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.729826    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 20:52:34.730952 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.730941    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 20:52:34.730995 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.730960    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 20:52:34.737916 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.737899    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 20:52:34.741272 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.740245    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 20:52:34.742152 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742138    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742157    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742167    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742174    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742182    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742188    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742193    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742198    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742204    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742209    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 20:52:34.742221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742222    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 20:52:34.742498 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.742228    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 20:52:34.743089 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.743075    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 20:52:34.743139 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.743093    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 20:52:34.744451 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.744431    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 20:52:34.744511 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.744461    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 20:52:34.746356 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.746343    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 20:52:34.746399 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.746384    2562 server.go:1295] "Started kubelet"
May 28 20:52:34.746529 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.746433    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 20:52:34.746529 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.746467    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 20:52:34.746529 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.746525    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 20:52:34.747155 ip-10-0-133-41 systemd[1]: Started Kubernetes Kubelet.
May 28 20:52:34.747855 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.747840    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 20:52:34.750461 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.750438    2562 server.go:317] "Adding debug handlers to kubelet server"
May 28 20:52:34.755788 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.755770    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 20:52:34.755988 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.755967    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 20:52:34.756936 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.756920    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 20:52:34.757132 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.755821    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-41.ec2.internal.18b3d5fbb24cb326  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-41.ec2.internal,UID:ip-10-0-133-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-41.ec2.internal,},FirstTimestamp:2026-05-28 20:52:34.746356518 +0000 UTC m=+0.424059930,LastTimestamp:2026-05-28 20:52:34.746356518 +0000 UTC m=+0.424059930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-41.ec2.internal,}"
May 28 20:52:34.757502 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757472    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 20:52:34.757577 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757562    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 20:52:34.757577 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757572    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 20:52:34.757767 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757730    2562 reconstruct.go:97] "Volume reconstruction finished"
May 28 20:52:34.757837 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757773    2562 reconciler.go:26] "Reconciler: start to sync state"
May 28 20:52:34.757837 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.757794    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 20:52:34.758098 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758085    2562 factory.go:55] Registering systemd factory
May 28 20:52:34.758182 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758138    2562 factory.go:223] Registration of the systemd container factory successfully
May 28 20:52:34.758443 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758428    2562 factory.go:153] Registering CRI-O factory
May 28 20:52:34.758498 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758446    2562 factory.go:223] Registration of the crio container factory successfully
May 28 20:52:34.758498 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.758467    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:34.758559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758506    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 20:52:34.758559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758521    2562 factory.go:103] Registering Raw factory
May 28 20:52:34.758559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758531    2562 manager.go:1196] Started watching for new ooms in manager
May 28 20:52:34.758887 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.758874    2562 manager.go:319] Starting recovery of all containers
May 28 20:52:34.760215 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.760147    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 20:52:34.760290 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.760269    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 20:52:34.764107 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.763942    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-977jq"
May 28 20:52:34.769476 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.769458    2562 manager.go:324] Recovery completed
May 28 20:52:34.770948 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.770925    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 20:52:34.773628 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.773616    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:34.775417 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775396    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-977jq"
May 28 20:52:34.775500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775432    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:34.775500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775451    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:34.775500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775466    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:34.775987 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775972    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 20:52:34.776046 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.775987    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 20:52:34.776046 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.776004    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 20:52:34.780396 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.780379    2562 policy_none.go:49] "None policy: Start"
May 28 20:52:34.780396 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.780399    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 20:52:34.780502 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.780410    2562 state_mem.go:35] "Initializing new in-memory state store"
May 28 20:52:34.810295 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810282    2562 manager.go:341] "Starting Device Plugin manager"
May 28 20:52:34.810394 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.810314    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 20:52:34.810394 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810323    2562 server.go:85] "Starting device plugin registration server"
May 28 20:52:34.810593 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810580    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 20:52:34.810640 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810596    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 20:52:34.810705 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810681    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 20:52:34.811269 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810791    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 20:52:34.811269 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.810804    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 20:52:34.811454 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.811408    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 20:52:34.811454 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.811439    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:34.910339 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.910266    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 20:52:34.910712 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.910697    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:34.911836 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.911817    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 20:52:34.911926 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.911852    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 20:52:34.911926 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.911893    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 20:52:34.911926 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.911904    2562 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 20:52:34.912063 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.911950    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 20:52:34.912211 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.912191    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:34.912251 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.912228    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:34.912251 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.912245    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:34.912317 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.912279    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-41.ec2.internal"
May 28 20:52:34.916048 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.916027    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 20:52:34.920971 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:34.920957    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-41.ec2.internal"
May 28 20:52:34.921037 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.920977    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-41.ec2.internal\": node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:34.964137 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:34.964112    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.012799 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.012780    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"]
May 28 20:52:35.012877 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.012865    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:35.013629 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.013606    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:35.013691 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.013634    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:35.013691 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.013644    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:35.014882 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.014870    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:35.015049 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015035    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.015102 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015064    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:35.015536 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015520    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:35.015597 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015540    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:35.015597 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015549    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:35.015597 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015574    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:35.015597 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015591    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:35.015718 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.015602    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:35.016548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.016534    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.016593 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.016559    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 20:52:35.017169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.017154    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientMemory"
May 28 20:52:35.017169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.017175    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasNoDiskPressure"
May 28 20:52:35.017169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.017184    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeHasSufficientPID"
May 28 20:52:35.049283 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.049260    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-41.ec2.internal\" not found" node="ip-10-0-133-41.ec2.internal"
May 28 20:52:35.053443 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.053426    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-41.ec2.internal\" not found" node="ip-10-0-133-41.ec2.internal"
May 28 20:52:35.058772 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.058738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.058826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.058785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.058857 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.058826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a359176032bf9805509c9b89251c4f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-41.ec2.internal\" (UID: \"29a359176032bf9805509c9b89251c4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.064785 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.064772    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.159418 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159398    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.159473 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159427    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.159473 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159443    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a359176032bf9805509c9b89251c4f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-41.ec2.internal\" (UID: \"29a359176032bf9805509c9b89251c4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.159549 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a359176032bf9805509c9b89251c4f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-41.ec2.internal\" (UID: \"29a359176032bf9805509c9b89251c4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.159549 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.159549 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.159504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c57a59d3bce71b8deb8f1ec67c0d637-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal\" (UID: \"0c57a59d3bce71b8deb8f1ec67c0d637\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.165541 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.165502    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.265965 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.265931    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.352096 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.352070    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.357004 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.356988    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:35.366522 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.366501    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.467096 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.467021    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.567549 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.567519    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.658893 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.658872    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 20:52:35.659390 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.659000    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 20:52:35.668162 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.668137    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.743269 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.743208    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 20:52:35.758678 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.758649    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 20:52:35.768657 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.768640    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.778188 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.778157    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 20:47:34 +0000 UTC" deadline="2027-12-11 02:34:10.422254255 +0000 UTC"
May 28 20:52:35.778188 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.778182    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13469h41m34.644074302s"
May 28 20:52:35.780856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.780844    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 20:52:35.809505 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:35.809476    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a359176032bf9805509c9b89251c4f.slice/crio-559f4e171e99bd1f12e167ef3045175b9683bcb6626c5f653e1a4ff3b93af81b WatchSource:0}: Error finding container 559f4e171e99bd1f12e167ef3045175b9683bcb6626c5f653e1a4ff3b93af81b: Status 404 returned error can't find the container with id 559f4e171e99bd1f12e167ef3045175b9683bcb6626c5f653e1a4ff3b93af81b
May 28 20:52:35.809729 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:35.809705    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c57a59d3bce71b8deb8f1ec67c0d637.slice/crio-da8d010f10ab0fbe7d09a012d8fc5cbf615a9bf38c0a617b5d9010a90fcc1634 WatchSource:0}: Error finding container da8d010f10ab0fbe7d09a012d8fc5cbf615a9bf38c0a617b5d9010a90fcc1634: Status 404 returned error can't find the container with id da8d010f10ab0fbe7d09a012d8fc5cbf615a9bf38c0a617b5d9010a90fcc1634
May 28 20:52:35.812667 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.812647    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:52:35.834446 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.834421    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fq68"
May 28 20:52:35.846939 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.846913    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fq68"
May 28 20:52:35.868901 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.868883    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:35.915894 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.915849    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal" event={"ID":"0c57a59d3bce71b8deb8f1ec67c0d637","Type":"ContainerStarted","Data":"da8d010f10ab0fbe7d09a012d8fc5cbf615a9bf38c0a617b5d9010a90fcc1634"}
May 28 20:52:35.916727 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:35.916707    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal" event={"ID":"29a359176032bf9805509c9b89251c4f","Type":"ContainerStarted","Data":"559f4e171e99bd1f12e167ef3045175b9683bcb6626c5f653e1a4ff3b93af81b"}
May 28 20:52:35.969149 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:35.969127    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:36.069632 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.069580    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:36.151424 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.151398    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 20:52:36.170542 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.170522    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:36.271372 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.271321    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-41.ec2.internal\" not found"
May 28 20:52:36.289086 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.289054    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 20:52:36.358601 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.358517    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal"
May 28 20:52:36.389183 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.389154    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 20:52:36.390167 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.390141    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal"
May 28 20:52:36.412788 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.412678    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 20:52:36.731562 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.731486    2562 apiserver.go:52] "Watching apiserver"
May 28 20:52:36.754580 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.754553    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 20:52:36.756522 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.756492    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kq6z5","openshift-dns/node-resolver-qhsfv","openshift-image-registry/node-ca-7fd75","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal","openshift-multus/multus-gbx42","openshift-network-diagnostics/network-check-target-vjztw","kube-system/konnectivity-agent-lnbhx","kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx","openshift-cluster-node-tuning-operator/tuned-jfkfc","openshift-multus/multus-additional-cni-plugins-r2qpq","openshift-multus/network-metrics-daemon-j7n5k","openshift-network-operator/iptables-alerter-xvw2g"]
May 28 20:52:36.758992 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.758969    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.759134 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.759109    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.760166 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.760144    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbx42"
May 28 20:52:36.761652 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.761633    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:36.761771 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.761702    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:36.764211 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.763923    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.765144 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.765126    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.765335 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.765321    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.767432 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.766492    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.767805 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.767585    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.768871 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.768851    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.768960 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.768915    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:36.769937 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.769917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.769950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-sys\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.769975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g9pw\" (UniqueName: \"kubernetes.io/projected/5435be84-e775-4437-92d1-dd2cef45fbd8-kube-api-access-7g9pw\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fea290a-5707-444e-a232-01472e06f610-serviceca\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.770033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770016    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.770033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-modprobe-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-kubernetes\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-run\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-tuned\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-conf\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-systemd\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-lib-modules\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-var-lib-kubelet\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fea290a-5707-444e-a232-01472e06f610-host\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.770279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h62w2\" (UniqueName: \"kubernetes.io/projected/8fea290a-5707-444e-a232-01472e06f610-kube-api-access-h62w2\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.770614 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysconfig\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770614 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-host\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.770614 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.770346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-tmp\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.771616 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.771595    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 20:52:36.771711 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.771627    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 20:52:36.771838 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.771807    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 20:52:36.771904 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.771882    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 20:52:36.772865 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.772658    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ffz75\""
May 28 20:52:36.773609 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.773471    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 20:52:36.773698 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.773684    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 20:52:36.774540 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.774522    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mwhzj\""
May 28 20:52:36.774989 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.774950    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 20:52:36.775796 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.775633    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.777656    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.777837    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zcl57\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778123    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778347    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778408    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778641    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778697    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c94qv\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778826    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778931    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.778952    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.779033    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 20:52:36.779276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.779048    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 20:52:36.779911 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.779518    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-289j5\""
May 28 20:52:36.779911 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.779669    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 20:52:36.780483 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.780464    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xnnl8\""
May 28 20:52:36.780697 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.780679    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 20:52:36.780797 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.780743    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 20:52:36.781048 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781030    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 20:52:36.781148 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781057    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 20:52:36.781148 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781091    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-blvfp\""
May 28 20:52:36.781263 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781232    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 20:52:36.781328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781311    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 20:52:36.781433 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781418    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 20:52:36.781597 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781583    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wf6w9\""
May 28 20:52:36.781744 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781730    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4qgsc\""
May 28 20:52:36.781877 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.781859    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 20:52:36.847602 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.847567    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 20:47:35 +0000 UTC" deadline="2027-12-06 21:08:39.24685746 +0000 UTC"
May 28 20:52:36.847713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.847597    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13368h16m2.399263349s"
May 28 20:52:36.859072 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.859048    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 20:52:36.870725 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870705    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-lib-modules\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.870840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870733    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-var-lib-kubelet\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.870840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-socket-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.870840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.870840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.871025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-lib-modules\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.871025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-var-lib-kubelet\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.871025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-registration-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.871025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.870995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-bin\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9kk\" (UniqueName: \"kubernetes.io/projected/faa33052-e358-4a91-b3a3-391fd3a4fda0-kube-api-access-qg9kk\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69886b82-0194-4826-96bf-de6716248fae-konnectivity-ca\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-sys-fs\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-node-log\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovn-node-metrics-cert\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-cnibin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-multus-daemon-config\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrf9\" (UniqueName: \"kubernetes.io/projected/0307ea36-bee5-419b-81c5-743d31a91b53-kube-api-access-6hrf9\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-tmp-dir\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871287    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-tuned\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-cnibin\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-os-release\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-k8s-cni-cncf-io\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-hostroot\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871420    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-conf\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-system-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-netns\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.871535 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-multus\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871560    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-sys\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871580    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g9pw\" (UniqueName: \"kubernetes.io/projected/5435be84-e775-4437-92d1-dd2cef45fbd8-kube-api-access-7g9pw\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-device-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-conf\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871636    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fs7\" (UniqueName: \"kubernetes.io/projected/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kube-api-access-d7fs7\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jnr\" (UniqueName: \"kubernetes.io/projected/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-kube-api-access-k7jnr\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871679    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-sys\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-script-lib\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-system-cni-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-ovn\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-os-release\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871893    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h62w2\" (UniqueName: \"kubernetes.io/projected/8fea290a-5707-444e-a232-01472e06f610-kube-api-access-h62w2\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.872052 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-iptables-alerter-script\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-log-socket\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.871986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-conf-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-multus-certs\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-hosts-file\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872072    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysconfig\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872127    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-host\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysconfig\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872180    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-host\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-kubelet\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-systemd-units\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-sysctl-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-netd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-bin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69886b82-0194-4826-96bf-de6716248fae-agent-certs\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.872713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872386    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-modprobe-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872414    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-kubernetes\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-config\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-env-overrides\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-cni-binary-copy\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872594    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-systemd\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872622    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fea290a-5707-444e-a232-01472e06f610-host\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-slash\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-kubernetes\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-etc-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-modprobe-d\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5x7r\" (UniqueName: \"kubernetes.io/projected/4fe38dc0-8991-4100-b32b-2f4201cce82e-kube-api-access-x5x7r\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872722    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-systemd\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872734    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fea290a-5707-444e-a232-01472e06f610-host\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-tmp\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-host-slash\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.873472 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-var-lib-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-socket-dir-parent\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-etc-kubernetes\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872905    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fea290a-5707-444e-a232-01472e06f610-serviceca\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-systemd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsw9m\" (UniqueName: \"kubernetes.io/projected/f8610169-a367-44ba-9b7f-4be7849bdee6-kube-api-access-hsw9m\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872973    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-run\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.872998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-netns\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.873022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-kubelet\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.873049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhk5h\" (UniqueName: \"kubernetes.io/projected/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-kube-api-access-jhk5h\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.873107    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5435be84-e775-4437-92d1-dd2cef45fbd8-run\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.874070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.873335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fea290a-5707-444e-a232-01472e06f610-serviceca\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.875027 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.875005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-etc-tuned\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.875115 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.875084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435be84-e775-4437-92d1-dd2cef45fbd8-tmp\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.885352 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.885331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h62w2\" (UniqueName: \"kubernetes.io/projected/8fea290a-5707-444e-a232-01472e06f610-kube-api-access-h62w2\") pod \"node-ca-7fd75\" (UID: \"8fea290a-5707-444e-a232-01472e06f610\") " pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:36.887667 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.887645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g9pw\" (UniqueName: \"kubernetes.io/projected/5435be84-e775-4437-92d1-dd2cef45fbd8-kube-api-access-7g9pw\") pod \"tuned-jfkfc\" (UID: \"5435be84-e775-4437-92d1-dd2cef45fbd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:36.973421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973378    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-multus-certs\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973437    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-hosts-file\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973471    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973498    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-kubelet\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-multus-certs\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973523    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-systemd-units\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973549    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-netd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973578    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-kubelet\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973587    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-bin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.973590 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973584    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-systemd-units\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973585    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-hosts-file\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-netd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-bin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973656    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69886b82-0194-4826-96bf-de6716248fae-agent-certs\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973690    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-config\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973715    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-env-overrides\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973739    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-cni-binary-copy\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973792    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-slash\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973822    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-etc-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973848    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5x7r\" (UniqueName: \"kubernetes.io/projected/4fe38dc0-8991-4100-b32b-2f4201cce82e-kube-api-access-x5x7r\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-slash\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973952    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-host-slash\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.973976    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-var-lib-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974000 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974001    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974028    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-socket-dir-parent\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974052    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-etc-kubernetes\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974064    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-etc-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974077    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-systemd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974104    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-var-lib-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974102    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw9m\" (UniqueName: \"kubernetes.io/projected/f8610169-a367-44ba-9b7f-4be7849bdee6-kube-api-access-hsw9m\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974143    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-netns\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974173    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-kubelet\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974196    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk5h\" (UniqueName: \"kubernetes.io/projected/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-kube-api-access-jhk5h\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974222    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-socket-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-env-overrides\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974249    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974273    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-netns\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-cni-binary-copy\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974302    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.974493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974319    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-config\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974327    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-registration-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974356    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-bin\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.974360    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-socket-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974383    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9kk\" (UniqueName: \"kubernetes.io/projected/faa33052-e358-4a91-b3a3-391fd3a4fda0-kube-api-access-qg9kk\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-kubelet\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974439    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69886b82-0194-4826-96bf-de6716248fae-konnectivity-ca\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.974467    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:37.474432071 +0000 UTC m=+3.152135501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-host-slash\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974587    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-sys-fs\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-registration-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974616    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-node-log\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovn-node-metrics-cert\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974652    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974668    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-cnibin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974690    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-node-log\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974693    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-multus-daemon-config\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrf9\" (UniqueName: \"kubernetes.io/projected/0307ea36-bee5-419b-81c5-743d31a91b53-kube-api-access-6hrf9\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974771    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-tmp-dir\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974799    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974824    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-cnibin\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974849    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-os-release\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974873    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-k8s-cni-cncf-io\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-socket-dir-parent\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974897    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-hostroot\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-etc-kubernetes\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-systemd\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-cnibin\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.975779 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975027    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69886b82-0194-4826-96bf-de6716248fae-konnectivity-ca\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975007    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-sys-fs\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975140    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975177    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-system-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0307ea36-bee5-419b-81c5-743d31a91b53-multus-daemon-config\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975207    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-netns\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975249    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-multus\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-tmp-dir\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-netns\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.974667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-cni-bin\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-system-cni-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975316    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-var-lib-cni-multus\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975327    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-device-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975279    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-device-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-hostroot\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-host-run-k8s-cni-cncf-io\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975370    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fs7\" (UniqueName: \"kubernetes.io/projected/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kube-api-access-d7fs7\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.976393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975419    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jnr\" (UniqueName: \"kubernetes.io/projected/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-kube-api-access-k7jnr\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975446    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975487    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-script-lib\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-cnibin\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975513    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-system-cni-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975541    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975549    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-os-release\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975565    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-ovn\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975589    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-os-release\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975615    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-ovn\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975639    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-iptables-alerter-script\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975711    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-log-socket\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-run-openvswitch\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975739    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-conf-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-os-release\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0307ea36-bee5-419b-81c5-743d31a91b53-multus-conf-dir\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.977169 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975848    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faa33052-e358-4a91-b3a3-391fd3a4fda0-log-socket\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.975881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe38dc0-8991-4100-b32b-2f4201cce82e-system-cni-dir\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.976102    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovnkube-script-lib\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.976233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-iptables-alerter-script\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.976422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe38dc0-8991-4100-b32b-2f4201cce82e-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.977001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69886b82-0194-4826-96bf-de6716248fae-agent-certs\") pod \"konnectivity-agent-lnbhx\" (UID: \"69886b82-0194-4826-96bf-de6716248fae\") " pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:36.977946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.977423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faa33052-e358-4a91-b3a3-391fd3a4fda0-ovn-node-metrics-cert\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.989292 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.989234    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:36.989292 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.989259    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:36.989292 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.989270    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:36.989540 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:36.989337    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:37.489318513 +0000 UTC m=+3.167021911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:36.990765 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.990723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9kk\" (UniqueName: \"kubernetes.io/projected/faa33052-e358-4a91-b3a3-391fd3a4fda0-kube-api-access-qg9kk\") pod \"ovnkube-node-kq6z5\" (UID: \"faa33052-e358-4a91-b3a3-391fd3a4fda0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:36.991834 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.991809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5x7r\" (UniqueName: \"kubernetes.io/projected/4fe38dc0-8991-4100-b32b-2f4201cce82e-kube-api-access-x5x7r\") pod \"multus-additional-cni-plugins-r2qpq\" (UID: \"4fe38dc0-8991-4100-b32b-2f4201cce82e\") " pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:36.992670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.992645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jnr\" (UniqueName: \"kubernetes.io/projected/26351eeb-47c4-4bd1-b92f-31680ad8a4cb-kube-api-access-k7jnr\") pod \"iptables-alerter-xvw2g\" (UID: \"26351eeb-47c4-4bd1-b92f-31680ad8a4cb\") " pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:36.992882 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.992867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrf9\" (UniqueName: \"kubernetes.io/projected/0307ea36-bee5-419b-81c5-743d31a91b53-kube-api-access-6hrf9\") pod \"multus-gbx42\" (UID: \"0307ea36-bee5-419b-81c5-743d31a91b53\") " pod="openshift-multus/multus-gbx42"
May 28 20:52:36.993701 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.993674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fs7\" (UniqueName: \"kubernetes.io/projected/2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159-kube-api-access-d7fs7\") pod \"aws-ebs-csi-driver-node-tvpbx\" (UID: \"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:36.994544 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.994523    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsw9m\" (UniqueName: \"kubernetes.io/projected/f8610169-a367-44ba-9b7f-4be7849bdee6-kube-api-access-hsw9m\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:36.995565 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:36.995543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhk5h\" (UniqueName: \"kubernetes.io/projected/9ed0f3f9-378d-4538-88f1-d1e4af2a8941-kube-api-access-jhk5h\") pod \"node-resolver-qhsfv\" (UID: \"9ed0f3f9-378d-4538-88f1-d1e4af2a8941\") " pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:37.033965 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.033932    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 20:52:37.071723 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.071693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfkfc"
May 28 20:52:37.079981 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.079956    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7fd75"
May 28 20:52:37.089732 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.089710    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbx42"
May 28 20:52:37.095526 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.095507    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:37.102065 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.102047    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhsfv"
May 28 20:52:37.109128 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.109102    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx"
May 28 20:52:37.116018 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.115999    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:52:37.121550 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.121532    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2qpq"
May 28 20:52:37.127070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.127051    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvw2g"
May 28 20:52:37.402138 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:37.402111    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed0f3f9_378d_4538_88f1_d1e4af2a8941.slice/crio-51582bb5898e82506386b671650669726bb145a1d295f0d2e5d5ae63b16c2416 WatchSource:0}: Error finding container 51582bb5898e82506386b671650669726bb145a1d295f0d2e5d5ae63b16c2416: Status 404 returned error can't find the container with id 51582bb5898e82506386b671650669726bb145a1d295f0d2e5d5ae63b16c2416
May 28 20:52:37.403324 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:37.403299    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26351eeb_47c4_4bd1_b92f_31680ad8a4cb.slice/crio-a93f6c7f40259e248ffe775350fccf98ea0d88516b8d7a5f589ecb326ba2741e WatchSource:0}: Error finding container a93f6c7f40259e248ffe775350fccf98ea0d88516b8d7a5f589ecb326ba2741e: Status 404 returned error can't find the container with id a93f6c7f40259e248ffe775350fccf98ea0d88516b8d7a5f589ecb326ba2741e
May 28 20:52:37.404188 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:37.404160    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe38dc0_8991_4100_b32b_2f4201cce82e.slice/crio-d9a29636de2104c22d8365a2aab5a214dfe2f9bfebe8824960a3595642c197bf WatchSource:0}: Error finding container d9a29636de2104c22d8365a2aab5a214dfe2f9bfebe8824960a3595642c197bf: Status 404 returned error can't find the container with id d9a29636de2104c22d8365a2aab5a214dfe2f9bfebe8824960a3595642c197bf
May 28 20:52:37.406120 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:37.406068    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5435be84_e775_4437_92d1_dd2cef45fbd8.slice/crio-bd2218f855cb2cf8f7c8eec827d423287b267df9cc9e1d2a4658378914ac717b WatchSource:0}: Error finding container bd2218f855cb2cf8f7c8eec827d423287b267df9cc9e1d2a4658378914ac717b: Status 404 returned error can't find the container with id bd2218f855cb2cf8f7c8eec827d423287b267df9cc9e1d2a4658378914ac717b
May 28 20:52:37.418731 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:52:37.418040    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0307ea36_bee5_419b_81c5_743d31a91b53.slice/crio-24e987c57b11cb0d1bacb907a9be316e33cc6e4f07ed2fc27ffc9a28ea23bc94 WatchSource:0}: Error finding container 24e987c57b11cb0d1bacb907a9be316e33cc6e4f07ed2fc27ffc9a28ea23bc94: Status 404 returned error can't find the container with id 24e987c57b11cb0d1bacb907a9be316e33cc6e4f07ed2fc27ffc9a28ea23bc94
May 28 20:52:37.478821 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.478617    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:37.478894 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.478761    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:37.478938 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.478918    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:38.478900165 +0000 UTC m=+4.156603566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:37.579292 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.579258    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:37.579432 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.579413    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:37.579467 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.579436    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:37.579467 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.579447    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:37.579553 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.579498    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:38.579482904 +0000 UTC m=+4.257186303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:37.848232 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.848167    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 20:47:35 +0000 UTC" deadline="2027-12-31 14:21:09.248927111 +0000 UTC"
May 28 20:52:37.848232 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.848203    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13961h28m31.400726904s"
May 28 20:52:37.912830 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.912338    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:37.912830 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:37.912469    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:37.930655 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.930612    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvw2g" event={"ID":"26351eeb-47c4-4bd1-b92f-31680ad8a4cb","Type":"ContainerStarted","Data":"a93f6c7f40259e248ffe775350fccf98ea0d88516b8d7a5f589ecb326ba2741e"}
May 28 20:52:37.934764 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.934690    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhsfv" event={"ID":"9ed0f3f9-378d-4538-88f1-d1e4af2a8941","Type":"ContainerStarted","Data":"51582bb5898e82506386b671650669726bb145a1d295f0d2e5d5ae63b16c2416"}
May 28 20:52:37.940588 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.940560    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal" event={"ID":"29a359176032bf9805509c9b89251c4f","Type":"ContainerStarted","Data":"d4752b1a2dc886a77faa9ec091c41fc42d09a5d65687d8ce24ff9feae73bc229"}
May 28 20:52:37.949772 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.948293    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7fd75" event={"ID":"8fea290a-5707-444e-a232-01472e06f610","Type":"ContainerStarted","Data":"ca61239c94d90224b541f68c72703d0a21837cda53c96cc9fac0b356c98dc4ed"}
May 28 20:52:37.952697 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.951185    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerStarted","Data":"d9a29636de2104c22d8365a2aab5a214dfe2f9bfebe8824960a3595642c197bf"}
May 28 20:52:37.956734 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.952879    2562 generic.go:358] "Generic (PLEG): container finished" podID="0c57a59d3bce71b8deb8f1ec67c0d637" containerID="b809a0bbd84ac188724bcb6d0b8dd8be48d5dfafd84384be2b482f6d1fb19f8f" exitCode=0
May 28 20:52:37.956734 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.952932    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal" event={"ID":"0c57a59d3bce71b8deb8f1ec67c0d637","Type":"ContainerDied","Data":"b809a0bbd84ac188724bcb6d0b8dd8be48d5dfafd84384be2b482f6d1fb19f8f"}
May 28 20:52:37.958004 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.957953    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnbhx" event={"ID":"69886b82-0194-4826-96bf-de6716248fae","Type":"ContainerStarted","Data":"70b9bdd0cc40733f4655473a085108e5e8e86bc0c93d864b68d0fc3e0314a827"}
May 28 20:52:37.960273 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.960231    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbx42" event={"ID":"0307ea36-bee5-419b-81c5-743d31a91b53","Type":"ContainerStarted","Data":"24e987c57b11cb0d1bacb907a9be316e33cc6e4f07ed2fc27ffc9a28ea23bc94"}
May 28 20:52:37.965243 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.965220    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"0ea6df6650e9731d209ed38ff8471e94dbf74c75fd044980dc9138c871dab5bd"}
May 28 20:52:37.967451 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.967425    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx" event={"ID":"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159","Type":"ContainerStarted","Data":"b069fa4f5811e8217e6aa56c2e415709603181a5db6e9fca22bbeb16f5400e78"}
May 28 20:52:37.970898 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:37.970873    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfkfc" event={"ID":"5435be84-e775-4437-92d1-dd2cef45fbd8","Type":"ContainerStarted","Data":"bd2218f855cb2cf8f7c8eec827d423287b267df9cc9e1d2a4658378914ac717b"}
May 28 20:52:38.006037 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:38.005987    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-41.ec2.internal" podStartSLOduration=2.005971972 podStartE2EDuration="2.005971972s" podCreationTimestamp="2026-05-28 20:52:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:52:37.96919477 +0000 UTC m=+3.646898192" watchObservedRunningTime="2026-05-28 20:52:38.005971972 +0000 UTC m=+3.683675395"
May 28 20:52:38.486775 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:38.486674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:38.486928 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.486854    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:38.486928 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.486912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:40.486895993 +0000 UTC m=+6.164599405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:38.587194 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:38.587159    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:38.587351 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.587329    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:38.587351 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.587348    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:38.587459 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.587361    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:38.587459 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.587424    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:40.58740616 +0000 UTC m=+6.265109564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:38.917823 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:38.915056    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:38.917823 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:38.915181    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:38.997499 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:38.997355    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal" event={"ID":"0c57a59d3bce71b8deb8f1ec67c0d637","Type":"ContainerStarted","Data":"b041fe175b2b2aaca81921b92cf62eabca12f514ac7849c37e3cb4f0bad119bf"}
May 28 20:52:39.913344 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:39.912643    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:39.913344 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:39.912802    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:40.506239 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:40.505623    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:40.506239 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.505798    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:40.506239 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.505867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:44.50584385 +0000 UTC m=+10.183547254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:40.606675 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:40.606075    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:40.606675 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.606224    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:40.606675 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.606251    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:40.606675 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.606264    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:40.606675 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.606329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:44.606308203 +0000 UTC m=+10.284011615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:40.912803 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:40.912273    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:40.912803 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:40.912400    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:41.912702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:41.912664    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:41.913187 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:41.912816    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:42.914989 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:42.914952    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:42.915472 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:42.915083    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:43.913362 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:43.912817    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:43.913362 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:43.912966    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:44.537916 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:44.537882    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:44.538375 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.538021    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:44.538375 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.538080    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:52.538061492 +0000 UTC m=+18.215764897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:44.639190 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:44.639152    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:44.639374 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.639344    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:44.639374 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.639364    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:44.639483 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.639377    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:44.639483 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.639434    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:52:52.639413591 +0000 UTC m=+18.317116989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:44.916373 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:44.915876    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:44.916373 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:44.915985    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:45.913005 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:45.912964    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:45.913496 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:45.913086    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:46.912841 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:46.912804    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:46.912989 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:46.912924    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:47.912390 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:47.912312    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:47.912815 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:47.912438    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:48.912359 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:48.912328    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:48.912537 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:48.912506    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:49.912825 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:49.912786    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:49.913242 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:49.912906    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:50.912648 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:50.912622    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:50.912826 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:50.912767    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:51.912379 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:51.912344    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:51.912805 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:51.912459    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:52.593880 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:52.593841    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:52.594041 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.594018    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:52.594107 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.594098    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:08.594077073 +0000 UTC m=+34.271780483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:52:52.694406 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:52.694370    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:52.694567 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.694509    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:52:52.694567 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.694530    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:52:52.694567 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.694542    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:52.694713 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.694615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:08.694580383 +0000 UTC m=+34.372283796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:52:52.913530 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:52.913032    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:52.913530 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:52.913142    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:53.912214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:53.912181    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:53.912497 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:53.912356    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:54.913348 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:54.913306    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:54.913761 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:54.913414    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:55.912277 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:55.912068    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:55.912475 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:55.912416    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:56.027142 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.026956    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnbhx" event={"ID":"69886b82-0194-4826-96bf-de6716248fae","Type":"ContainerStarted","Data":"6bec99a30b1fb6590ec602983d9ef99796735678011d0bed75ef8ab370dac432"}
May 28 20:52:56.028443 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.028417    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbx42" event={"ID":"0307ea36-bee5-419b-81c5-743d31a91b53","Type":"ContainerStarted","Data":"b5f8517003d9650688a7d07015ec40edb353a065d2bb37d1da829869302d742a"}
May 28 20:52:56.029621 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.029597    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"2cb69bd14d23bfc9bc6cde9e852433a5c3ed102b00c251a3ee2c49710f99173c"}
May 28 20:52:56.031093 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.031069    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx" event={"ID":"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159","Type":"ContainerStarted","Data":"6d059aed8520039b783358bb6d57ae4cc518d6274dfa7eface7eca9f263f51cc"}
May 28 20:52:56.032585 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.032563    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfkfc" event={"ID":"5435be84-e775-4437-92d1-dd2cef45fbd8","Type":"ContainerStarted","Data":"93277a33202a5c5548d2e4b611e18d081b305bd80a286f6216b130d1586d6993"}
May 28 20:52:56.034083 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.034063    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhsfv" event={"ID":"9ed0f3f9-378d-4538-88f1-d1e4af2a8941","Type":"ContainerStarted","Data":"ea229492e14735bc6365d3676c27da8ea9251388cf5974007ad6dae347db55d4"}
May 28 20:52:56.036157 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.036082    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7fd75" event={"ID":"8fea290a-5707-444e-a232-01472e06f610","Type":"ContainerStarted","Data":"9f428dd851e2b29038c243146b36adf5946a66e0366988fb62276feda2d2db37"}
May 28 20:52:56.039198 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.038072    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="cdfbb532595274f35a28874f6afe14f94b75e300737eba423b64aecd949bdb9c" exitCode=0
May 28 20:52:56.039198 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.038114    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"cdfbb532595274f35a28874f6afe14f94b75e300737eba423b64aecd949bdb9c"}
May 28 20:52:56.045351 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.045316    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-41.ec2.internal" podStartSLOduration=20.045306494 podStartE2EDuration="20.045306494s" podCreationTimestamp="2026-05-28 20:52:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:52:39.029729994 +0000 UTC m=+4.707433416" watchObservedRunningTime="2026-05-28 20:52:56.045306494 +0000 UTC m=+21.723009920"
May 28 20:52:56.064280 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.064240    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnbhx" podStartSLOduration=8.632406218 podStartE2EDuration="22.064227664s" podCreationTimestamp="2026-05-28 20:52:34 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.416955006 +0000 UTC m=+3.094658419" lastFinishedPulling="2026-05-28 20:52:50.848776463 +0000 UTC m=+16.526479865" observedRunningTime="2026-05-28 20:52:56.044956859 +0000 UTC m=+21.722660280" watchObservedRunningTime="2026-05-28 20:52:56.064227664 +0000 UTC m=+21.741931102"
May 28 20:52:56.064424 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.064399    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jfkfc" podStartSLOduration=3.779498228 podStartE2EDuration="22.06439388s" podCreationTimestamp="2026-05-28 20:52:34 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.415151398 +0000 UTC m=+3.092854797" lastFinishedPulling="2026-05-28 20:52:55.700047045 +0000 UTC m=+21.377750449" observedRunningTime="2026-05-28 20:52:56.064361693 +0000 UTC m=+21.742065100" watchObservedRunningTime="2026-05-28 20:52:56.06439388 +0000 UTC m=+21.742097301"
May 28 20:52:56.084630 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.084591    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gbx42" podStartSLOduration=3.78520669 podStartE2EDuration="22.084578533s" podCreationTimestamp="2026-05-28 20:52:34 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.419971555 +0000 UTC m=+3.097674953" lastFinishedPulling="2026-05-28 20:52:55.719343397 +0000 UTC m=+21.397046796" observedRunningTime="2026-05-28 20:52:56.084170828 +0000 UTC m=+21.761874248" watchObservedRunningTime="2026-05-28 20:52:56.084578533 +0000 UTC m=+21.762281954"
May 28 20:52:56.103228 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.103185    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qhsfv" podStartSLOduration=2.827762407 podStartE2EDuration="21.103174277s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.404651492 +0000 UTC m=+3.082354896" lastFinishedPulling="2026-05-28 20:52:55.680063356 +0000 UTC m=+21.357766766" observedRunningTime="2026-05-28 20:52:56.102661206 +0000 UTC m=+21.780364630" watchObservedRunningTime="2026-05-28 20:52:56.103174277 +0000 UTC m=+21.780877698"
May 28 20:52:56.124770 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.124308    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7fd75" podStartSLOduration=3.842355675 podStartE2EDuration="22.124293702s" podCreationTimestamp="2026-05-28 20:52:34 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.416168617 +0000 UTC m=+3.093872021" lastFinishedPulling="2026-05-28 20:52:55.69810663 +0000 UTC m=+21.375810048" observedRunningTime="2026-05-28 20:52:56.12414364 +0000 UTC m=+21.801847063" watchObservedRunningTime="2026-05-28 20:52:56.124293702 +0000 UTC m=+21.801997124"
May 28 20:52:56.421543 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.421512    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:56.422107 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.422086    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:56.913042 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.913014    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:56.913189 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:56.913145    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:56.923076 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:56.923055    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 20:52:57.042856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.042776    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"7e5e8d66a6b57914cd87578d137b1120f620d95620ddb83ac7f3ebc05cb39fe7"}
May 28 20:52:57.042856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.042813    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"6b80024467f3840890c765d8a6deb21ec96b05346c9dcd94bdc817ca2be9baf4"}
May 28 20:52:57.042856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.042828    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"4b2a573d112c185d9eeabbcb7a43fd210c1efc24376764b0bf6c24b3ff9748ed"}
May 28 20:52:57.042856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.042841    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"bf0ce8d68d5fee49bd38a3a79f28b73a641067c7bd4e9683d153c5a86193aea1"}
May 28 20:52:57.042856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.042854    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"905b88ce904005fa781e39e1d4a874ef84872e38cbadd80af6a942e589cb7e3c"}
May 28 20:52:57.044582 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.044543    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx" event={"ID":"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159","Type":"ContainerStarted","Data":"61f2c0594b0d7d56372e5a8a0238ab7d24080316087aa24d5b9e3b6e128e9e72"}
May 28 20:52:57.822711 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.822626    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T20:52:56.923073016Z","UUID":"9f02283f-ec36-4458-8acb-1159ddeb35b6","Handler":null,"Name":"","Endpoint":""}
May 28 20:52:57.825598 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.825573    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 20:52:57.825698 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.825617    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 20:52:57.912627 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:57.912591    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:57.912772 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:57.912710    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:52:58.047407 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.047325    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvw2g" event={"ID":"26351eeb-47c4-4bd1-b92f-31680ad8a4cb","Type":"ContainerStarted","Data":"aca1a027360ab7292b9c21d3ad29dce7cf9bacc5862a83d435a243a285181147"}
May 28 20:52:58.049314 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.049286    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx" event={"ID":"2b4b5439-dfd2-4bdf-9c84-1bb1bf2a2159","Type":"ContainerStarted","Data":"2ba99d5589b624f83f5d83023350e07abd36fec06b3811d086f3d39abe25bb06"}
May 28 20:52:58.049419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.049321    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 20:52:58.098629 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.098583    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xvw2g" podStartSLOduration=4.806348942 podStartE2EDuration="23.098570202s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.406036465 +0000 UTC m=+3.083739870" lastFinishedPulling="2026-05-28 20:52:55.698257728 +0000 UTC m=+21.375961130" observedRunningTime="2026-05-28 20:52:58.077541344 +0000 UTC m=+23.755244764" watchObservedRunningTime="2026-05-28 20:52:58.098570202 +0000 UTC m=+23.776273623"
May 28 20:52:58.358622 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.358539    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:58.359268 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.359248    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnbhx"
May 28 20:52:58.381966 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.381917    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvpbx" podStartSLOduration=3.088444909 podStartE2EDuration="23.381902781s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.415936673 +0000 UTC m=+3.093640089" lastFinishedPulling="2026-05-28 20:52:57.70939455 +0000 UTC m=+23.387097961" observedRunningTime="2026-05-28 20:52:58.098465762 +0000 UTC m=+23.776169186" watchObservedRunningTime="2026-05-28 20:52:58.381902781 +0000 UTC m=+24.059606204"
May 28 20:52:58.912880 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:58.912636    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:52:58.913064 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:58.912993    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:52:59.054287 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:59.054222    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"069a82c4bfe1450a15a7fd44e3c709bb643dea451446b96ec6a81d3acfcccd2f"}
May 28 20:52:59.912617 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:52:59.912542    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:52:59.912819 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:52:59.912654    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:00.913008 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:00.912746    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:00.913008 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:00.913002    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:53:01.059076 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.059044    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="58d34a82e3e0987577e790605c0d894bca5e0d640782045965ebb942abb171d8" exitCode=0
May 28 20:53:01.059230 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.059128    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"58d34a82e3e0987577e790605c0d894bca5e0d640782045965ebb942abb171d8"}
May 28 20:53:01.062372 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.062349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" event={"ID":"faa33052-e358-4a91-b3a3-391fd3a4fda0","Type":"ContainerStarted","Data":"ea66f36162669674bf9424cc80de1858050e950d77e59504683e0a2b9cb43a0a"}
May 28 20:53:01.062561 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.062549    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:01.062632 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.062616    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:01.078803 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.078779    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:01.913111 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:01.913072    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:01.913477 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:01.913190    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:02.072816 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.072787    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:02.088646 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.088613    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:02.124527 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.124479    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5" podStartSLOduration=8.79334541 podStartE2EDuration="27.124466232s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.418919399 +0000 UTC m=+3.096622798" lastFinishedPulling="2026-05-28 20:52:55.750040203 +0000 UTC m=+21.427743620" observedRunningTime="2026-05-28 20:53:01.142348024 +0000 UTC m=+26.820051444" watchObservedRunningTime="2026-05-28 20:53:02.124466232 +0000 UTC m=+27.802169632"
May 28 20:53:02.529628 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.529552    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7n5k"]
May 28 20:53:02.529793 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.529666    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:02.529793 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:02.529745    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:02.532840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.532816    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjztw"]
May 28 20:53:02.532963 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:02.532902    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:02.533027 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:02.532964    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:53:03.075613 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:03.075582    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="1c66acb1fe7cef2499c05e5305b529cba05c753a7305fee1a3c6d082e98932f6" exitCode=0
May 28 20:53:03.076015 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:03.075662    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"1c66acb1fe7cef2499c05e5305b529cba05c753a7305fee1a3c6d082e98932f6"}
May 28 20:53:03.913050 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:03.913011    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:03.913181 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:03.913011    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:03.913181 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:03.913121    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:03.913254 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:03.913190    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:53:05.081360 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:05.081100    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="8d40a886c5a025ee60f7135cf720d305ac212bbcd8f7d1e32dbd983b68e79196" exitCode=0
May 28 20:53:05.081360 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:05.081177    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"8d40a886c5a025ee60f7135cf720d305ac212bbcd8f7d1e32dbd983b68e79196"}
May 28 20:53:05.912937 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:05.912903    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:05.913110 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:05.912903    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:05.913110 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:05.913055    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:05.913234 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:05.913116    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:53:07.912356 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:07.912324    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:07.913074 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:07.912324    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:07.913074 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:07.912459    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7n5k" podUID="f8610169-a367-44ba-9b7f-4be7849bdee6"
May 28 20:53:07.913074 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:07.912500    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjztw" podUID="53f2130c-1ac7-425f-86f5-edec363cdd55"
May 28 20:53:08.622706 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.622612    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:08.622874 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.622780    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:53:08.622874 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.622858    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:40.622838052 +0000 UTC m=+66.300541464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 20:53:08.670242 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.670214    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-41.ec2.internal" event="NodeReady"
May 28 20:53:08.670405 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.670315    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 20:53:08.723845 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.723814    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:08.724011 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.723964    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 20:53:08.724011 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.723981    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 20:53:08.724011 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.723994    2562 projected.go:194] Error preparing data for projected volume kube-api-access-wp8d8 for pod openshift-network-diagnostics/network-check-target-vjztw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:53:08.724172 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:08.724046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8 podName:53f2130c-1ac7-425f-86f5-edec363cdd55 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:40.724032615 +0000 UTC m=+66.401736014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8d8" (UniqueName: "kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8") pod "network-check-target-vjztw" (UID: "53f2130c-1ac7-425f-86f5-edec363cdd55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 20:53:08.752958 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.752927    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-924m8"]
May 28 20:53:08.763012 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.762991    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v5vst"]
May 28 20:53:08.763135 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.763121    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-924m8"
May 28 20:53:08.768452 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.768428    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 20:53:08.768567 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.768550    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6mfq4\""
May 28 20:53:08.769970 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.769947    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 20:53:08.771100 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.771081    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:08.774192 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.774169    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 20:53:08.774279 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.774206    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 20:53:08.775785 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.775245    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 20:53:08.775785 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.775276    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gngfj\""
May 28 20:53:08.782984 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.782968    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-924m8"]
May 28 20:53:08.783489 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.783460    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v5vst"]
May 28 20:53:08.925054 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.924960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhztz\" (UniqueName: \"kubernetes.io/projected/5a74cd70-3edc-45cb-8883-cebba1e226a4-kube-api-access-zhztz\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:08.925054 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.925014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:08.925054 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.925051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:08.925731 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.925072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a74cd70-3edc-45cb-8883-cebba1e226a4-config-volume\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:08.925731 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.925124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6c86\" (UniqueName: \"kubernetes.io/projected/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-kube-api-access-j6c86\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:08.925731 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:08.925149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a74cd70-3edc-45cb-8883-cebba1e226a4-tmp-dir\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.026327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026286    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026336    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026358    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a74cd70-3edc-45cb-8883-cebba1e226a4-config-volume\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026401    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6c86\" (UniqueName: \"kubernetes.io/projected/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-kube-api-access-j6c86\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026439    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a74cd70-3edc-45cb-8883-cebba1e226a4-tmp-dir\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.026454    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:09.026507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.026467    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhztz\" (UniqueName: \"kubernetes.io/projected/5a74cd70-3edc-45cb-8883-cebba1e226a4-kube-api-access-zhztz\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.026827 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.026520    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:09.026827 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.026534    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:09.526509284 +0000 UTC m=+35.204212699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:09.026827 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.026577    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:09.526558734 +0000 UTC m=+35.204262139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:09.027106 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.027077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a74cd70-3edc-45cb-8883-cebba1e226a4-tmp-dir\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.027246 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.027225    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a74cd70-3edc-45cb-8883-cebba1e226a4-config-volume\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.046348 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.046329    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhztz\" (UniqueName: \"kubernetes.io/projected/5a74cd70-3edc-45cb-8883-cebba1e226a4-kube-api-access-zhztz\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.046575 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.046555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6c86\" (UniqueName: \"kubernetes.io/projected/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-kube-api-access-j6c86\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:09.531028 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.530985    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:09.531223 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.531037    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:09.531223 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.531148    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:09.531223 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.531150    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:09.531223 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.531208    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:10.531191005 +0000 UTC m=+36.208894404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:09.531223 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:09.531224    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:10.53121567 +0000 UTC m=+36.208919068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:09.912562 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.912483    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:09.912713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.912494    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:09.918196 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.918172    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 20:53:09.918471 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.918449    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 20:53:09.919593 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.919448    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kbvdl\""
May 28 20:53:09.919593 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.919486    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 20:53:09.919727 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:09.919684    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jf7t\""
May 28 20:53:10.539101 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:10.539064    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:10.539585 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:10.539106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:10.539585 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:10.539216    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:10.539585 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:10.539256    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:10.539585 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:10.539322    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:12.539303943 +0000 UTC m=+38.217007359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:10.539585 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:10.539341    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:12.539332609 +0000 UTC m=+38.217036023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:11.096291 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:11.096262    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerStarted","Data":"a6c4de9b63d7b5c6aa19cb5cbcdb2d733801e1ce8a368489ba70d8dc1f624541"}
May 28 20:53:12.100546 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:12.100517    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="a6c4de9b63d7b5c6aa19cb5cbcdb2d733801e1ce8a368489ba70d8dc1f624541" exitCode=0
May 28 20:53:12.100945 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:12.100572    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"a6c4de9b63d7b5c6aa19cb5cbcdb2d733801e1ce8a368489ba70d8dc1f624541"}
May 28 20:53:12.552841 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:12.552808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:12.552978 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:12.552847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:12.552978 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:12.552961    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:12.553056 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:12.553000    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:12.553056 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:12.553031    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:16.553006461 +0000 UTC m=+42.230709869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:12.553128 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:12.553062    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:16.553050693 +0000 UTC m=+42.230754091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:13.104878 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:13.104847    2562 generic.go:358] "Generic (PLEG): container finished" podID="4fe38dc0-8991-4100-b32b-2f4201cce82e" containerID="6f7e90ac74d9b2c711632ed6b5558ae665e66377517662b4cf7d83a50e83ba68" exitCode=0
May 28 20:53:13.105335 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:13.104898    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerDied","Data":"6f7e90ac74d9b2c711632ed6b5558ae665e66377517662b4cf7d83a50e83ba68"}
May 28 20:53:14.109996 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:14.109957    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" event={"ID":"4fe38dc0-8991-4100-b32b-2f4201cce82e","Type":"ContainerStarted","Data":"f54c3760c3229d1e4756d9ec2484c300b964a1a1c1875526f95bbbdc971f1cd5"}
May 28 20:53:14.147854 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:14.147809    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r2qpq" podStartSLOduration=5.5862309 podStartE2EDuration="39.147796686s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:52:37.406339896 +0000 UTC m=+3.084043295" lastFinishedPulling="2026-05-28 20:53:10.967905676 +0000 UTC m=+36.645609081" observedRunningTime="2026-05-28 20:53:14.146461565 +0000 UTC m=+39.824164996" watchObservedRunningTime="2026-05-28 20:53:14.147796686 +0000 UTC m=+39.825500107"
May 28 20:53:16.580476 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:16.580421    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:16.580476 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:16.580481    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:16.580975 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:16.580584    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:16.580975 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:16.580664    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:24.58064767 +0000 UTC m=+50.258351069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:16.580975 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:16.580584    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:16.580975 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:16.580725    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:24.580713673 +0000 UTC m=+50.258417126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:24.633943 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:24.633901    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:24.633943 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:24.633943    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:24.634588 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:24.634051    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:24.634588 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:24.634051    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:24.634588 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:24.634108    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:40.634091741 +0000 UTC m=+66.311795141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:24.634588 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:24.634121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:40.634115299 +0000 UTC m=+66.311818697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:34.087854 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:34.087820    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kq6z5"
May 28 20:53:40.638617 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.638582    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.638631    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.638651    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.638725    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.638767    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.638794    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:12.638780486 +0000 UTC m=+98.316483903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:53:40.639177 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.638842    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls podName:5a74cd70-3edc-45cb-8883-cebba1e226a4 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:12.638818948 +0000 UTC m=+98.316522362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls") pod "dns-default-924m8" (UID: "5a74cd70-3edc-45cb-8883-cebba1e226a4") : secret "dns-default-metrics-tls" not found
May 28 20:53:40.641759 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.641732    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 20:53:40.648822 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.648807    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 20:53:40.648863 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:40.648847    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs podName:f8610169-a367-44ba-9b7f-4be7849bdee6 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:44.648836838 +0000 UTC m=+130.326540241 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs") pod "network-metrics-daemon-j7n5k" (UID: "f8610169-a367-44ba-9b7f-4be7849bdee6") : secret "metrics-daemon-secret" not found
May 28 20:53:40.739837 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.739807    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:40.742639 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.742623    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 20:53:40.753229 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.753215    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 20:53:40.764724 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.764700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8d8\" (UniqueName: \"kubernetes.io/projected/53f2130c-1ac7-425f-86f5-edec363cdd55-kube-api-access-wp8d8\") pod \"network-check-target-vjztw\" (UID: \"53f2130c-1ac7-425f-86f5-edec363cdd55\") " pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:40.827681 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.827657    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jf7t\""
May 28 20:53:40.835289 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.835270    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:40.962190 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:40.962153    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjztw"]
May 28 20:53:40.966187 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:53:40.966154    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f2130c_1ac7_425f_86f5_edec363cdd55.slice/crio-2753bb9f19d520bc31c90f1ab4feda768320f736a4947e2f34a8165ba74bf7d5 WatchSource:0}: Error finding container 2753bb9f19d520bc31c90f1ab4feda768320f736a4947e2f34a8165ba74bf7d5: Status 404 returned error can't find the container with id 2753bb9f19d520bc31c90f1ab4feda768320f736a4947e2f34a8165ba74bf7d5
May 28 20:53:41.163486 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:41.163449    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjztw" event={"ID":"53f2130c-1ac7-425f-86f5-edec363cdd55","Type":"ContainerStarted","Data":"2753bb9f19d520bc31c90f1ab4feda768320f736a4947e2f34a8165ba74bf7d5"}
May 28 20:53:44.170165 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:44.170130    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjztw" event={"ID":"53f2130c-1ac7-425f-86f5-edec363cdd55","Type":"ContainerStarted","Data":"a4fce10eb3cd8500c7392ed9d9b06aa9c7451177ee5471c47010e31894ad15c6"}
May 28 20:53:44.170522 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:44.170252    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:53:44.186262 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:44.186222    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vjztw" podStartSLOduration=67.59487289 podStartE2EDuration="1m10.186210792s" podCreationTimestamp="2026-05-28 20:52:34 +0000 UTC" firstStartedPulling="2026-05-28 20:53:40.967991504 +0000 UTC m=+66.645694904" lastFinishedPulling="2026-05-28 20:53:43.559329404 +0000 UTC m=+69.237032806" observedRunningTime="2026-05-28 20:53:44.185526848 +0000 UTC m=+69.863230268" watchObservedRunningTime="2026-05-28 20:53:44.186210792 +0000 UTC m=+69.863914253"
May 28 20:53:58.974505 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.974366    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"]
May 28 20:53:58.976826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.976806    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:58.981137 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.981109    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 20:53:58.982094 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.982074    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 20:53:58.982710 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.982687    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m6fnj\""
May 28 20:53:58.982830 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.982696    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 20:53:58.982830 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.982735    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 20:53:58.983637 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.983614    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fbw9p"]
May 28 20:53:58.985246 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.985230    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:58.987677 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.987658    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"]
May 28 20:53:58.987850 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.987830    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 20:53:58.987923 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.987841    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qtv4n\""
May 28 20:53:58.988116 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.988100    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 20:53:58.988248 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.988234    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 20:53:58.988316 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.988247    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 20:53:58.993586 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:58.993563    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 20:53:59.000455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.000439    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fbw9p"]
May 28 20:53:59.058284 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.058389 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.058389 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.058389 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mlj\" (UniqueName: \"kubernetes.io/projected/1169c1ed-2cd3-4627-b491-a282b93c71b7-kube-api-access-95mlj\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.058389 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-tmp\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.058556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vpsv\" (UniqueName: \"kubernetes.io/projected/656e4bcb-2c8b-4200-b0cc-49c5aee32699-kube-api-access-5vpsv\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.058556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/656e4bcb-2c8b-4200-b0cc-49c5aee32699-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.058556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-snapshots\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.058556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.058480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169c1ed-2cd3-4627-b491-a282b93c71b7-serving-cert\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.083138 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.083114    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-t28r6"]
May 28 20:53:59.084822 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.084809    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.088167 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.088147    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 20:53:59.088263 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.088147    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 20:53:59.088447 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.088428    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 20:53:59.089077 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.089054    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 20:53:59.089176 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.089078    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gjfw2\""
May 28 20:53:59.090010 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.089986    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:53:59.092394 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.092378    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.093691 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.093672    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 20:53:59.096106 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.096088    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 20:53:59.096222 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.096207    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jrtjt\""
May 28 20:53:59.096924 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.096907    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 20:53:59.097307 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.097293    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 20:53:59.104907 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.104882    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 20:53:59.112195 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.112173    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-t28r6"]
May 28 20:53:59.113128 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.113108    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:53:59.159021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159002    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-tmp\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159138 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159030    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vpsv\" (UniqueName: \"kubernetes.io/projected/656e4bcb-2c8b-4200-b0cc-49c5aee32699-kube-api-access-5vpsv\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.159138 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159138 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159259 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-config\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.159259 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-trusted-ca\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.159259 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159259 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxlct\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159259 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159254    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/656e4bcb-2c8b-4200-b0cc-49c5aee32699-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-serving-cert\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-snapshots\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169c1ed-2cd3-4627-b491-a282b93c71b7-serving-cert\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-tmp\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vt2q\" (UniqueName: \"kubernetes.io/projected/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-kube-api-access-2vt2q\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159500    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159533    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159640    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.159715    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159723    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95mlj\" (UniqueName: \"kubernetes.io/projected/1169c1ed-2cd3-4627-b491-a282b93c71b7-kube-api-access-95mlj\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.159780 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.160133 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.159793    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:59.659775881 +0000 UTC m=+85.337479280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:53:59.160133 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.159967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1169c1ed-2cd3-4627-b491-a282b93c71b7-snapshots\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.160235 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.160176    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/656e4bcb-2c8b-4200-b0cc-49c5aee32699-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.161039 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.161013    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.161131 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.161099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1169c1ed-2cd3-4627-b491-a282b93c71b7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.162075 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.162058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169c1ed-2cd3-4627-b491-a282b93c71b7-serving-cert\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.167951 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.167929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vpsv\" (UniqueName: \"kubernetes.io/projected/656e4bcb-2c8b-4200-b0cc-49c5aee32699-kube-api-access-5vpsv\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.168474 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.168455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mlj\" (UniqueName: \"kubernetes.io/projected/1169c1ed-2cd3-4627-b491-a282b93c71b7-kube-api-access-95mlj\") pod \"insights-operator-78bdfb888c-fbw9p\" (UID: \"1169c1ed-2cd3-4627-b491-a282b93c71b7\") " pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.260408 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260329    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260408 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260361    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260408 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260383    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-config\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.260408 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260398    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-trusted-ca\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.260702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260534    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260576    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxlct\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260608    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-serving-cert\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.260884 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260816    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260884 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260878    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.260994 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260906    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vt2q\" (UniqueName: \"kubernetes.io/projected/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-kube-api-access-2vt2q\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.260994 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.260980    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.261115 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.261014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.261115 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.261103    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.261217 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.261118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-config\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.261217 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.261178    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.261374 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.261278    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 20:53:59.261374 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.261310    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4479bbf4-7t4hk: secret "image-registry-tls" not found
May 28 20:53:59.261374 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.261277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-trusted-ca\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.261512 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.261376    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls podName:87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5 nodeName:}" failed. No retries permitted until 2026-05-28 20:53:59.761355729 +0000 UTC m=+85.439059152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls") pod "image-registry-b4479bbf4-7t4hk" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5") : secret "image-registry-tls" not found
May 28 20:53:59.262270 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.262249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.263474 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.263449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.263554 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.263540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-serving-cert\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.263691 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.263668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.271267 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.271240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.272272 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.272253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vt2q\" (UniqueName: \"kubernetes.io/projected/591a44ff-c166-40aa-bdfb-1f8b444dd0b1-kube-api-access-2vt2q\") pod \"console-operator-76dff48d59-t28r6\" (UID: \"591a44ff-c166-40aa-bdfb-1f8b444dd0b1\") " pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.272469 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.272454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxlct\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.293431 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.293401    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p"
May 28 20:53:59.394264 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.394228    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:53:59.435702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.435666    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fbw9p"]
May 28 20:53:59.439408 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:53:59.439358    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1169c1ed_2cd3_4627_b491_a282b93c71b7.slice/crio-a0819f713b68765fded26c1e888a9b7cbb30b58ed815455b77132f762c6a8e31 WatchSource:0}: Error finding container a0819f713b68765fded26c1e888a9b7cbb30b58ed815455b77132f762c6a8e31: Status 404 returned error can't find the container with id a0819f713b68765fded26c1e888a9b7cbb30b58ed815455b77132f762c6a8e31
May 28 20:53:59.512782 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.512697    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-t28r6"]
May 28 20:53:59.515123 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:53:59.515097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591a44ff_c166_40aa_bdfb_1f8b444dd0b1.slice/crio-926f34601ba8c4f96087e008d8298d2926ef005688075a2e4a31aec8ea1d697f WatchSource:0}: Error finding container 926f34601ba8c4f96087e008d8298d2926ef005688075a2e4a31aec8ea1d697f: Status 404 returned error can't find the container with id 926f34601ba8c4f96087e008d8298d2926ef005688075a2e4a31aec8ea1d697f
May 28 20:53:59.665208 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.665170    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:53:59.665373 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.665322    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:53:59.665415 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.665390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:00.665374239 +0000 UTC m=+86.343077637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:53:59.766412 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:53:59.766321    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:53:59.766575 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.766491    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 20:53:59.766575 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.766511    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4479bbf4-7t4hk: secret "image-registry-tls" not found
May 28 20:53:59.766682 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:53:59.766578    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls podName:87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:00.766555544 +0000 UTC m=+86.444258946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls") pod "image-registry-b4479bbf4-7t4hk" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5") : secret "image-registry-tls" not found
May 28 20:54:00.202487 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:00.202449    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" event={"ID":"591a44ff-c166-40aa-bdfb-1f8b444dd0b1","Type":"ContainerStarted","Data":"926f34601ba8c4f96087e008d8298d2926ef005688075a2e4a31aec8ea1d697f"}
May 28 20:54:00.203818 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:00.203790    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p" event={"ID":"1169c1ed-2cd3-4627-b491-a282b93c71b7","Type":"ContainerStarted","Data":"a0819f713b68765fded26c1e888a9b7cbb30b58ed815455b77132f762c6a8e31"}
May 28 20:54:00.671887 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:00.671854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:00.672045 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:00.672004    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:54:00.672085 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:00.672063    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:02.672048213 +0000 UTC m=+88.349751615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:54:00.773101 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:00.773057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:00.773287 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:00.773226    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 20:54:00.773287 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:00.773247    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4479bbf4-7t4hk: secret "image-registry-tls" not found
May 28 20:54:00.773394 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:00.773315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls podName:87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:02.773295537 +0000 UTC m=+88.450998937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls") pod "image-registry-b4479bbf4-7t4hk" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5") : secret "image-registry-tls" not found
May 28 20:54:02.208708 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.208666    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p" event={"ID":"1169c1ed-2cd3-4627-b491-a282b93c71b7","Type":"ContainerStarted","Data":"b50fc3d717f60dbcd0b290f393399e52a2520e6a8ccaafc9b44542e93507fcd4"}
May 28 20:54:02.210177 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.210157    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/0.log"
May 28 20:54:02.210406 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.210200    2562 generic.go:358] "Generic (PLEG): container finished" podID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1" containerID="d925c7b83826ae4f4977a667829b3f83d90d62e69058ab36c838e2a7a6b0c4f6" exitCode=255
May 28 20:54:02.210406 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.210231    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" event={"ID":"591a44ff-c166-40aa-bdfb-1f8b444dd0b1","Type":"ContainerDied","Data":"d925c7b83826ae4f4977a667829b3f83d90d62e69058ab36c838e2a7a6b0c4f6"}
May 28 20:54:02.210482 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.210416    2562 scope.go:117] "RemoveContainer" containerID="d925c7b83826ae4f4977a667829b3f83d90d62e69058ab36c838e2a7a6b0c4f6"
May 28 20:54:02.224840 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.224629    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p" podStartSLOduration=1.996619455 podStartE2EDuration="4.224613244s" podCreationTimestamp="2026-05-28 20:53:58 +0000 UTC" firstStartedPulling="2026-05-28 20:53:59.442035014 +0000 UTC m=+85.119738413" lastFinishedPulling="2026-05-28 20:54:01.670028802 +0000 UTC m=+87.347732202" observedRunningTime="2026-05-28 20:54:02.22419869 +0000 UTC m=+87.901902112" watchObservedRunningTime="2026-05-28 20:54:02.224613244 +0000 UTC m=+87.902316666"
May 28 20:54:02.688722 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.688674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:02.688918 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:02.688844    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:54:02.688964 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:02.688920    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:06.688902329 +0000 UTC m=+92.366605735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:54:02.789899 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:02.789861    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:02.790047 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:02.790008    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 20:54:02.790047 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:02.790024    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4479bbf4-7t4hk: secret "image-registry-tls" not found
May 28 20:54:02.790122 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:02.790076    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls podName:87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:06.790061553 +0000 UTC m=+92.467764953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls") pod "image-registry-b4479bbf4-7t4hk" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5") : secret "image-registry-tls" not found
May 28 20:54:03.213563 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.213532    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/1.log"
May 28 20:54:03.213960 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.213918    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/0.log"
May 28 20:54:03.213960 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.213949    2562 generic.go:358] "Generic (PLEG): container finished" podID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66" exitCode=255
May 28 20:54:03.214074 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.214047    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" event={"ID":"591a44ff-c166-40aa-bdfb-1f8b444dd0b1","Type":"ContainerDied","Data":"f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"}
May 28 20:54:03.214117 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.214100    2562 scope.go:117] "RemoveContainer" containerID="d925c7b83826ae4f4977a667829b3f83d90d62e69058ab36c838e2a7a6b0c4f6"
May 28 20:54:03.214312 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:03.214289    2562 scope.go:117] "RemoveContainer" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"
May 28 20:54:03.214563 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:03.214546    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:04.216763 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:04.216718    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/1.log"
May 28 20:54:04.217110 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:04.217067    2562 scope.go:117] "RemoveContainer" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"
May 28 20:54:04.217268 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:04.217249    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:05.269435 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.269404    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhsfv_9ed0f3f9-378d-4538-88f1-d1e4af2a8941/dns-node-resolver/0.log"
May 28 20:54:05.431213 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.431182    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ppx6n"]
May 28 20:54:05.433644 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.433629    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.436671 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.436645    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 20:54:05.436977 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.436956    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 20:54:05.437737 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.437718    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 20:54:05.437856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.437778    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 20:54:05.437856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.437787    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v949r\""
May 28 20:54:05.441920 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.441898    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ppx6n"]
May 28 20:54:05.512021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.511994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-cabundle\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.512150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.512033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77qc\" (UniqueName: \"kubernetes.io/projected/80c101a7-c740-448c-8b73-cf90144fc3b6-kube-api-access-n77qc\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.512150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.512086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-key\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.612834 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.612799    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-cabundle\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.612940 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.612844    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n77qc\" (UniqueName: \"kubernetes.io/projected/80c101a7-c740-448c-8b73-cf90144fc3b6-kube-api-access-n77qc\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.612993 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.612939    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-key\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.613428 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.613411    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-cabundle\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.615354 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.615333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c101a7-c740-448c-8b73-cf90144fc3b6-signing-key\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.622322 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.622304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77qc\" (UniqueName: \"kubernetes.io/projected/80c101a7-c740-448c-8b73-cf90144fc3b6-kube-api-access-n77qc\") pod \"service-ca-67d667c7d-ppx6n\" (UID: \"80c101a7-c740-448c-8b73-cf90144fc3b6\") " pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.745282 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.745258    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ppx6n"
May 28 20:54:05.866388 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.866327    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ppx6n"]
May 28 20:54:05.869153 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:05.869123    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c101a7_c740_448c_8b73_cf90144fc3b6.slice/crio-8de8ac1b4fb6f02a9009553672d8a5a43d7a19dd032a7bc0c9962910aeab2e76 WatchSource:0}: Error finding container 8de8ac1b4fb6f02a9009553672d8a5a43d7a19dd032a7bc0c9962910aeab2e76: Status 404 returned error can't find the container with id 8de8ac1b4fb6f02a9009553672d8a5a43d7a19dd032a7bc0c9962910aeab2e76
May 28 20:54:05.870460 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:05.870440    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7fd75_8fea290a-5707-444e-a232-01472e06f610/node-ca/0.log"
May 28 20:54:06.222028 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:06.221958    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ppx6n" event={"ID":"80c101a7-c740-448c-8b73-cf90144fc3b6","Type":"ContainerStarted","Data":"8de8ac1b4fb6f02a9009553672d8a5a43d7a19dd032a7bc0c9962910aeab2e76"}
May 28 20:54:06.722547 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:06.722504    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:06.722954 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:06.722663    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:54:06.722954 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:06.722733    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:14.722716384 +0000 UTC m=+100.400419787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:54:06.823669 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:06.823638    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:06.823841 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:06.823798    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 20:54:06.823841 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:06.823816    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4479bbf4-7t4hk: secret "image-registry-tls" not found
May 28 20:54:06.823912 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:06.823880    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls podName:87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:14.82386359 +0000 UTC m=+100.501566993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls") pod "image-registry-b4479bbf4-7t4hk" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5") : secret "image-registry-tls" not found
May 28 20:54:08.228349 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:08.228310    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ppx6n" event={"ID":"80c101a7-c740-448c-8b73-cf90144fc3b6","Type":"ContainerStarted","Data":"e5f956e33cc0f03156ddf2095f00040a4235389fb83cedfac4f30003f591833a"}
May 28 20:54:08.244947 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:08.244899    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ppx6n" podStartSLOduration=1.71056871 podStartE2EDuration="3.244881993s" podCreationTimestamp="2026-05-28 20:54:05 +0000 UTC" firstStartedPulling="2026-05-28 20:54:05.871179665 +0000 UTC m=+91.548883082" lastFinishedPulling="2026-05-28 20:54:07.405492964 +0000 UTC m=+93.083196365" observedRunningTime="2026-05-28 20:54:08.244514969 +0000 UTC m=+93.922218393" watchObservedRunningTime="2026-05-28 20:54:08.244881993 +0000 UTC m=+93.922585414"
May 28 20:54:09.394865 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:09.394817    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:09.394865 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:09.394874    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:09.395288 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:09.395266    2562 scope.go:117] "RemoveContainer" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"
May 28 20:54:09.395471 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:09.395450    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:12.666238 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.666207    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:54:12.666626 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.666270    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:54:12.666626 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:12.666358    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 20:54:12.666626 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:12.666406    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert podName:cd1ae37a-66c4-4ae8-9bed-4b33783a50b2 nodeName:}" failed. No retries permitted until 2026-05-28 20:55:16.666392858 +0000 UTC m=+162.344096257 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert") pod "ingress-canary-v5vst" (UID: "cd1ae37a-66c4-4ae8-9bed-4b33783a50b2") : secret "canary-serving-cert" not found
May 28 20:54:12.668548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.668525    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a74cd70-3edc-45cb-8883-cebba1e226a4-metrics-tls\") pod \"dns-default-924m8\" (UID: \"5a74cd70-3edc-45cb-8883-cebba1e226a4\") " pod="openshift-dns/dns-default-924m8"
May 28 20:54:12.676418 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.676392    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6mfq4\""
May 28 20:54:12.684687 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.684673    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-924m8"
May 28 20:54:12.806406 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:12.806374    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-924m8"]
May 28 20:54:12.809302 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:12.809278    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a74cd70_3edc_45cb_8883_cebba1e226a4.slice/crio-78a99f9a582410f48a27c2a17ce3b14ef19571c1a4101100e95ab61fd5829ba1 WatchSource:0}: Error finding container 78a99f9a582410f48a27c2a17ce3b14ef19571c1a4101100e95ab61fd5829ba1: Status 404 returned error can't find the container with id 78a99f9a582410f48a27c2a17ce3b14ef19571c1a4101100e95ab61fd5829ba1
May 28 20:54:13.239345 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:13.239310    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-924m8" event={"ID":"5a74cd70-3edc-45cb-8883-cebba1e226a4","Type":"ContainerStarted","Data":"78a99f9a582410f48a27c2a17ce3b14ef19571c1a4101100e95ab61fd5829ba1"}
May 28 20:54:14.783267 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:14.783237    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:14.783707 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:14.783336    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 20:54:14.783707 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:14.783387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls podName:656e4bcb-2c8b-4200-b0cc-49c5aee32699 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:30.783371884 +0000 UTC m=+116.461075283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lw5fb" (UID: "656e4bcb-2c8b-4200-b0cc-49c5aee32699") : secret "cluster-monitoring-operator-tls" not found
May 28 20:54:14.883715 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:14.883675    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:14.886162 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:14.886139    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"image-registry-b4479bbf4-7t4hk\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") " pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:15.001670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.001647    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:15.127984 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.127954    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:54:15.130691 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:15.130658    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a2be6e_0fa5_4d0b_a441_13b4cffa8fb5.slice/crio-a3d47546127f614c6d402ea738ff2d374e10f08174fedf2d8b3d2f1d213b3221 WatchSource:0}: Error finding container a3d47546127f614c6d402ea738ff2d374e10f08174fedf2d8b3d2f1d213b3221: Status 404 returned error can't find the container with id a3d47546127f614c6d402ea738ff2d374e10f08174fedf2d8b3d2f1d213b3221
May 28 20:54:15.174855 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.174833    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vjztw"
May 28 20:54:15.245993 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.245960    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-924m8" event={"ID":"5a74cd70-3edc-45cb-8883-cebba1e226a4","Type":"ContainerStarted","Data":"3c47a01c99b4b015ba4b072dd1495827d9996e271da2944650780f64ad69499d"}
May 28 20:54:15.246123 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.246001    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-924m8" event={"ID":"5a74cd70-3edc-45cb-8883-cebba1e226a4","Type":"ContainerStarted","Data":"cbd002857d0fac917bd06502630bb9b463df5ae07a9ff031f2a48c6bb9e39b01"}
May 28 20:54:15.246123 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.246041    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-924m8"
May 28 20:54:15.247214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.247194    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" event={"ID":"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5","Type":"ContainerStarted","Data":"603d877f001c23adb24fe921cad0a6857a887a1863c1633be414a6c298775b89"}
May 28 20:54:15.247298 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.247219    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" event={"ID":"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5","Type":"ContainerStarted","Data":"a3d47546127f614c6d402ea738ff2d374e10f08174fedf2d8b3d2f1d213b3221"}
May 28 20:54:15.247385 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.247371    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:15.263410 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.263368    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-924m8" podStartSLOduration=65.883224598 podStartE2EDuration="1m7.263356156s" podCreationTimestamp="2026-05-28 20:53:08 +0000 UTC" firstStartedPulling="2026-05-28 20:54:12.811382938 +0000 UTC m=+98.489086337" lastFinishedPulling="2026-05-28 20:54:14.191514488 +0000 UTC m=+99.869217895" observedRunningTime="2026-05-28 20:54:15.26220282 +0000 UTC m=+100.939906438" watchObservedRunningTime="2026-05-28 20:54:15.263356156 +0000 UTC m=+100.941059613"
May 28 20:54:15.279304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:15.279267    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" podStartSLOduration=16.279256141 podStartE2EDuration="16.279256141s" podCreationTimestamp="2026-05-28 20:53:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:54:15.278680393 +0000 UTC m=+100.956383827" watchObservedRunningTime="2026-05-28 20:54:15.279256141 +0000 UTC m=+100.956959561"
May 28 20:54:24.913867 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:24.913831    2562 scope.go:117] "RemoveContainer" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"
May 28 20:54:25.251957 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.251881    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-924m8"
May 28 20:54:25.276725 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.276704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 20:54:25.277104 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.277089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/1.log"
May 28 20:54:25.277185 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.277129    2562 generic.go:358] "Generic (PLEG): container finished" podID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1" containerID="77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648" exitCode=255
May 28 20:54:25.277185 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.277178    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" event={"ID":"591a44ff-c166-40aa-bdfb-1f8b444dd0b1","Type":"ContainerDied","Data":"77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648"}
May 28 20:54:25.277256 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.277206    2562 scope.go:117] "RemoveContainer" containerID="f83f5353a683e00a64240802e75d72b05def401801105f26afb2768bb7d24d66"
May 28 20:54:25.277520 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:25.277497    2562 scope.go:117] "RemoveContainer" containerID="77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648"
May 28 20:54:25.277692 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:25.277672    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:26.169253 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.169216    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"]
May 28 20:54:26.172396 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.172381    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.177013 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.176991    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wr56x\""
May 28 20:54:26.177013 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.176998    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 20:54:26.177197 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.176989    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 20:54:26.187012 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.186991    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"]
May 28 20:54:26.223624 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.223589    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sns5f"]
May 28 20:54:26.226962 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.226943    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:54:26.227106 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.227091    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.230193 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.230173    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gc8h7\""
May 28 20:54:26.230536 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.230520    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 20:54:26.231294 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.231279    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 20:54:26.243884 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.243864    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sns5f"]
May 28 20:54:26.260895 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.260874    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8976b64d5-xm7jc"]
May 28 20:54:26.263808 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.263792    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.269869 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.269833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be31af03-732b-4ed0-822b-fee69fce22b0-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.270010 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.269954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be31af03-732b-4ed0-822b-fee69fce22b0-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.279112 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.279080    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8976b64d5-xm7jc"]
May 28 20:54:26.280854 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.280833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 20:54:26.371221 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-image-registry-private-configuration\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371323 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skg78\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-kube-api-access-skg78\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371323 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.371323 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-trusted-ca\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rrc\" (UniqueName: \"kubernetes.io/projected/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-api-access-r5rrc\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.371455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371375    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be31af03-732b-4ed0-822b-fee69fce22b0-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.371455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aaba363-200d-4eb2-bc6f-b955a1fca940-data-volume\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.371455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-bound-sa-token\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371455 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-registry-certificates\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-registry-tls\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aaba363-200d-4eb2-bc6f-b955a1fca940-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-installation-pull-secrets\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aaba363-200d-4eb2-bc6f-b955a1fca940-crio-socket\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371610    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be31af03-732b-4ed0-822b-fee69fce22b0-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.371688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.371632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d35503e7-0393-4558-a6c5-22cb254c116a-ca-trust-extracted\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.372209 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.372192    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be31af03-732b-4ed0-822b-fee69fce22b0-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.373842 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.373824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be31af03-732b-4ed0-822b-fee69fce22b0-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-56bmz\" (UID: \"be31af03-732b-4ed0-822b-fee69fce22b0\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.472904 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.472847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skg78\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-kube-api-access-skg78\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.472904 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.472887    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.472913    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-trusted-ca\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.472943    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rrc\" (UniqueName: \"kubernetes.io/projected/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-api-access-r5rrc\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.472975    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aaba363-200d-4eb2-bc6f-b955a1fca940-data-volume\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473000    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-bound-sa-token\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473026    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-registry-certificates\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473178    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-registry-tls\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aaba363-200d-4eb2-bc6f-b955a1fca940-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473259    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-installation-pull-secrets\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aaba363-200d-4eb2-bc6f-b955a1fca940-data-volume\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473307    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aaba363-200d-4eb2-bc6f-b955a1fca940-crio-socket\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5aaba363-200d-4eb2-bc6f-b955a1fca940-crio-socket\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473362    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d35503e7-0393-4558-a6c5-22cb254c116a-ca-trust-extracted\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473409    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-image-registry-private-configuration\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473851 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.473851 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473776    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d35503e7-0393-4558-a6c5-22cb254c116a-ca-trust-extracted\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.473959 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.473865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-registry-certificates\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.474274 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.474247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d35503e7-0393-4558-a6c5-22cb254c116a-trusted-ca\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.475836 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.475816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5aaba363-200d-4eb2-bc6f-b955a1fca940-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.475935 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.475912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-registry-tls\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.476083 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.476064    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-image-registry-private-configuration\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.476355 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.476334    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d35503e7-0393-4558-a6c5-22cb254c116a-installation-pull-secrets\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.480417 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.480291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-bound-sa-token\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.480417 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.480370    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"
May 28 20:54:26.480625 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.480607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rrc\" (UniqueName: \"kubernetes.io/projected/5aaba363-200d-4eb2-bc6f-b955a1fca940-kube-api-access-r5rrc\") pod \"insights-runtime-extractor-sns5f\" (UID: \"5aaba363-200d-4eb2-bc6f-b955a1fca940\") " pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.480836 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.480813    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skg78\" (UniqueName: \"kubernetes.io/projected/d35503e7-0393-4558-a6c5-22cb254c116a-kube-api-access-skg78\") pod \"image-registry-8976b64d5-xm7jc\" (UID: \"d35503e7-0393-4558-a6c5-22cb254c116a\") " pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.537486 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.537456    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sns5f"
May 28 20:54:26.572088 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.572058    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:26.607376 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.607349    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz"]
May 28 20:54:26.609651 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:26.609618    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe31af03_732b_4ed0_822b_fee69fce22b0.slice/crio-0567c821b385a729e0f48545869002cc95be10052502fad3940d48f55f130865 WatchSource:0}: Error finding container 0567c821b385a729e0f48545869002cc95be10052502fad3940d48f55f130865: Status 404 returned error can't find the container with id 0567c821b385a729e0f48545869002cc95be10052502fad3940d48f55f130865
May 28 20:54:26.671724 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.671692    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sns5f"]
May 28 20:54:26.673959 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:26.673926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaba363_200d_4eb2_bc6f_b955a1fca940.slice/crio-319150becfbd3641f0f89238aa7f97b03d2558e4263c2b18a42929212739dd6f WatchSource:0}: Error finding container 319150becfbd3641f0f89238aa7f97b03d2558e4263c2b18a42929212739dd6f: Status 404 returned error can't find the container with id 319150becfbd3641f0f89238aa7f97b03d2558e4263c2b18a42929212739dd6f
May 28 20:54:26.715892 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:26.715861    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8976b64d5-xm7jc"]
May 28 20:54:26.718906 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:26.718883    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35503e7_0393_4558_a6c5_22cb254c116a.slice/crio-d0f35762b33080c7c1cda03a5bcea522a5ecb3d45fbbbad5be888a0c2110d174 WatchSource:0}: Error finding container d0f35762b33080c7c1cda03a5bcea522a5ecb3d45fbbbad5be888a0c2110d174: Status 404 returned error can't find the container with id d0f35762b33080c7c1cda03a5bcea522a5ecb3d45fbbbad5be888a0c2110d174
May 28 20:54:27.285825 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.285791    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz" event={"ID":"be31af03-732b-4ed0-822b-fee69fce22b0","Type":"ContainerStarted","Data":"0567c821b385a729e0f48545869002cc95be10052502fad3940d48f55f130865"}
May 28 20:54:27.287769 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.287726    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc" event={"ID":"d35503e7-0393-4558-a6c5-22cb254c116a","Type":"ContainerStarted","Data":"d0ac9bb6c8b1cfdb93d4d68ffa5c94917cc1f362a6a853b991bfd35ea4ad59f6"}
May 28 20:54:27.287892 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.287784    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc" event={"ID":"d35503e7-0393-4558-a6c5-22cb254c116a","Type":"ContainerStarted","Data":"d0f35762b33080c7c1cda03a5bcea522a5ecb3d45fbbbad5be888a0c2110d174"}
May 28 20:54:27.287976 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.287956    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:27.289029 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.289004    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sns5f" event={"ID":"5aaba363-200d-4eb2-bc6f-b955a1fca940","Type":"ContainerStarted","Data":"344c91e5f692e31b0f7c0c75c15c8fdde32fba1e8353fad36326dd7ad246417d"}
May 28 20:54:27.289142 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.289034    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sns5f" event={"ID":"5aaba363-200d-4eb2-bc6f-b955a1fca940","Type":"ContainerStarted","Data":"319150becfbd3641f0f89238aa7f97b03d2558e4263c2b18a42929212739dd6f"}
May 28 20:54:27.305144 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:27.305093    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc" podStartSLOduration=1.305082172 podStartE2EDuration="1.305082172s" podCreationTimestamp="2026-05-28 20:54:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:54:27.304465871 +0000 UTC m=+112.982169293" watchObservedRunningTime="2026-05-28 20:54:27.305082172 +0000 UTC m=+112.982785625"
May 28 20:54:28.293487 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:28.293452    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz" event={"ID":"be31af03-732b-4ed0-822b-fee69fce22b0","Type":"ContainerStarted","Data":"12016221429f5726db24d3fa259a780622a9f02b5d15cdf01fdaaef46ae6af0e"}
May 28 20:54:28.295523 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:28.295497    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sns5f" event={"ID":"5aaba363-200d-4eb2-bc6f-b955a1fca940","Type":"ContainerStarted","Data":"4e1506d4a986ca029d4afa5c9f5abc47daa3d893670fa2505c14848b179d5c94"}
May 28 20:54:28.310199 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:28.310153    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-56bmz" podStartSLOduration=1.158710245 podStartE2EDuration="2.310140299s" podCreationTimestamp="2026-05-28 20:54:26 +0000 UTC" firstStartedPulling="2026-05-28 20:54:26.6116473 +0000 UTC m=+112.289350707" lastFinishedPulling="2026-05-28 20:54:27.763077358 +0000 UTC m=+113.440780761" observedRunningTime="2026-05-28 20:54:28.30970571 +0000 UTC m=+113.987409131" watchObservedRunningTime="2026-05-28 20:54:28.310140299 +0000 UTC m=+113.987843720"
May 28 20:54:29.300147 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:29.300057    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sns5f" event={"ID":"5aaba363-200d-4eb2-bc6f-b955a1fca940","Type":"ContainerStarted","Data":"d078e069b26b5392f4b88492ae7e7fa8ddaed8f0e71958cce01a854900cdf6e8"}
May 28 20:54:29.317393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:29.317346    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sns5f" podStartSLOduration=1.151902127 podStartE2EDuration="3.31733263s" podCreationTimestamp="2026-05-28 20:54:26 +0000 UTC" firstStartedPulling="2026-05-28 20:54:26.737723612 +0000 UTC m=+112.415427014" lastFinishedPulling="2026-05-28 20:54:28.903154115 +0000 UTC m=+114.580857517" observedRunningTime="2026-05-28 20:54:29.316438618 +0000 UTC m=+114.994142040" watchObservedRunningTime="2026-05-28 20:54:29.31733263 +0000 UTC m=+114.995036050"
May 28 20:54:29.394336 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:29.394316    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:29.394421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:29.394401    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:29.394621 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:29.394608    2562 scope.go:117] "RemoveContainer" containerID="77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648"
May 28 20:54:29.394809 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:29.394788    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:30.303737 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:30.303700    2562 scope.go:117] "RemoveContainer" containerID="77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648"
May 28 20:54:30.304167 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:30.303931    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-t28r6_openshift-console-operator(591a44ff-c166-40aa-bdfb-1f8b444dd0b1)\"" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podUID="591a44ff-c166-40aa-bdfb-1f8b444dd0b1"
May 28 20:54:30.809090 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:30.809040    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:30.811548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:30.811528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/656e4bcb-2c8b-4200-b0cc-49c5aee32699-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lw5fb\" (UID: \"656e4bcb-2c8b-4200-b0cc-49c5aee32699\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:31.085688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:31.085613    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"
May 28 20:54:31.202730 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:31.202700    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb"]
May 28 20:54:31.205471 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:31.205440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656e4bcb_2c8b_4200_b0cc_49c5aee32699.slice/crio-619854ebac378d4fcfc3eb3a28913032d6395442e674ea56cfb345176560f9a8 WatchSource:0}: Error finding container 619854ebac378d4fcfc3eb3a28913032d6395442e674ea56cfb345176560f9a8: Status 404 returned error can't find the container with id 619854ebac378d4fcfc3eb3a28913032d6395442e674ea56cfb345176560f9a8
May 28 20:54:31.306626 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:31.306590    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb" event={"ID":"656e4bcb-2c8b-4200-b0cc-49c5aee32699","Type":"ContainerStarted","Data":"619854ebac378d4fcfc3eb3a28913032d6395442e674ea56cfb345176560f9a8"}
May 28 20:54:34.314680 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:34.314646    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb" event={"ID":"656e4bcb-2c8b-4200-b0cc-49c5aee32699","Type":"ContainerStarted","Data":"4c48ef2890db7ee37775b1d543d52aa2da4a39cf1bf4d56d0257f9191ec8dfa7"}
May 28 20:54:34.332670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:34.332620    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lw5fb" podStartSLOduration=33.824013626 podStartE2EDuration="36.332608158s" podCreationTimestamp="2026-05-28 20:53:58 +0000 UTC" firstStartedPulling="2026-05-28 20:54:31.207346519 +0000 UTC m=+116.885049919" lastFinishedPulling="2026-05-28 20:54:33.715941052 +0000 UTC m=+119.393644451" observedRunningTime="2026-05-28 20:54:34.330899574 +0000 UTC m=+120.008603163" watchObservedRunningTime="2026-05-28 20:54:34.332608158 +0000 UTC m=+120.010311578"
May 28 20:54:36.231912 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:36.231880    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:41.590124 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.590087    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"]
May 28 20:54:41.593122 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.593094    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.595689 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.595664    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 20:54:41.595828 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.595698    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 20:54:41.596935 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.596914    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wspxx\""
May 28 20:54:41.597039 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.596920    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 20:54:41.603217 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.603192    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"]
May 28 20:54:41.609993 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.609973    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"]
May 28 20:54:41.611984 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.611970    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.614969 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.614794    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 20:54:41.615163 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.615145    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 20:54:41.616627 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.616608    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 20:54:41.616962 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.616887    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qzcfr\""
May 28 20:54:41.626239 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.624820    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4q6wl"]
May 28 20:54:41.627704 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.627269    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"]
May 28 20:54:41.627704 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.627389    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.630500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.630381    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 20:54:41.630607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.630553    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 20:54:41.630607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.630592    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 20:54:41.631042 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.630842    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pxmvg\""
May 28 20:54:41.693116 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.693090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3caa507-a541-48ed-ab50-362c1a100c04-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.693233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.693130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkpkp\" (UniqueName: \"kubernetes.io/projected/d3caa507-a541-48ed-ab50-362c1a100c04-kube-api-access-fkpkp\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.693233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.693179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.693343 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.693250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.794419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.794566 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wb7\" (UniqueName: \"kubernetes.io/projected/e856df1b-d02a-4bf5-a081-d840870c87a5-kube-api-access-79wb7\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.794566 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.794566 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794505    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3caa507-a541-48ed-ab50-362c1a100c04-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.794566 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794534    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkpkp\" (UniqueName: \"kubernetes.io/projected/d3caa507-a541-48ed-ab50-362c1a100c04-kube-api-access-fkpkp\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.794804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-root\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.794804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42p4w\" (UniqueName: \"kubernetes.io/projected/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-api-access-42p4w\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.794804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.794804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-sys\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.794804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794796    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794875    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:41.794922    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80d8df27-47fb-4935-bcf6-ad6e8e51c986-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.794972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.795000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-metrics-client-ca\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.795030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.795070 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.795054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-textfile\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.795528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.795078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-wtmp\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.795528 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:41.795178    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls podName:d3caa507-a541-48ed-ab50-362c1a100c04 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:42.295160699 +0000 UTC m=+127.972864103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-vc8pb" (UID: "d3caa507-a541-48ed-ab50-362c1a100c04") : secret "openshift-state-metrics-tls" not found
May 28 20:54:41.795528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.795238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3caa507-a541-48ed-ab50-362c1a100c04-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.797424 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.797404    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.805481 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.805445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkpkp\" (UniqueName: \"kubernetes.io/projected/d3caa507-a541-48ed-ab50-362c1a100c04-kube-api-access-fkpkp\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:41.896246 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79wb7\" (UniqueName: \"kubernetes.io/projected/e856df1b-d02a-4bf5-a081-d840870c87a5-kube-api-access-79wb7\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896246 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896223    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896272    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-root\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896316    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42p4w\" (UniqueName: \"kubernetes.io/projected/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-api-access-42p4w\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896341    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896371    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-sys\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896421 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896415    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896446    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896476    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80d8df27-47fb-4935-bcf6-ad6e8e51c986-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896508    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896537    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-metrics-client-ca\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-sys\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896612 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896566    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896616    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-textfile\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896643    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-wtmp\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.896915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.896684    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.896915 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:41.896850    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 20:54:41.896915 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:54:41.896912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls podName:e856df1b-d02a-4bf5-a081-d840870c87a5 nodeName:}" failed. No retries permitted until 2026-05-28 20:54:42.396890293 +0000 UTC m=+128.074593694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls") pod "node-exporter-4q6wl" (UID: "e856df1b-d02a-4bf5-a081-d840870c87a5") : secret "node-exporter-tls" not found
May 28 20:54:41.897196 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897016    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80d8df27-47fb-4935-bcf6-ad6e8e51c986-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.897410 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.897673 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.897829 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-wtmp\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.897911 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d8df27-47fb-4935-bcf6-ad6e8e51c986-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.898011 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.897985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e856df1b-d02a-4bf5-a081-d840870c87a5-root\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.898476 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.898450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e856df1b-d02a-4bf5-a081-d840870c87a5-metrics-client-ca\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.898588 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.898547    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-textfile\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.899465 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.899444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.899593 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.899574    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.899894 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.899877    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.907696 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.907676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wb7\" (UniqueName: \"kubernetes.io/projected/e856df1b-d02a-4bf5-a081-d840870c87a5-kube-api-access-79wb7\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:41.907872 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.907830    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42p4w\" (UniqueName: \"kubernetes.io/projected/80d8df27-47fb-4935-bcf6-ad6e8e51c986-kube-api-access-42p4w\") pod \"kube-state-metrics-54fd6bc5c4-8x9jm\" (UID: \"80d8df27-47fb-4935-bcf6-ad6e8e51c986\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:41.923398 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:41.923368    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"
May 28 20:54:42.058214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.058188    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm"]
May 28 20:54:42.060777 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:42.060731    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d8df27_47fb_4935_bcf6_ad6e8e51c986.slice/crio-b241ee5c9b059f50cd014980aac08d68290cd32fda9d8a923121cf709400e1cb WatchSource:0}: Error finding container b241ee5c9b059f50cd014980aac08d68290cd32fda9d8a923121cf709400e1cb: Status 404 returned error can't find the container with id b241ee5c9b059f50cd014980aac08d68290cd32fda9d8a923121cf709400e1cb
May 28 20:54:42.300412 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.300339    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:42.302645 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.302626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3caa507-a541-48ed-ab50-362c1a100c04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vc8pb\" (UID: \"d3caa507-a541-48ed-ab50-362c1a100c04\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:42.335170 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.335142    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm" event={"ID":"80d8df27-47fb-4935-bcf6-ad6e8e51c986","Type":"ContainerStarted","Data":"b241ee5c9b059f50cd014980aac08d68290cd32fda9d8a923121cf709400e1cb"}
May 28 20:54:42.401357 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.401332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:42.403528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.403504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e856df1b-d02a-4bf5-a081-d840870c87a5-node-exporter-tls\") pod \"node-exporter-4q6wl\" (UID: \"e856df1b-d02a-4bf5-a081-d840870c87a5\") " pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:42.505885 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.505853    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"
May 28 20:54:42.538650 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.538615    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q6wl"
May 28 20:54:42.552488 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:42.552421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode856df1b_d02a_4bf5_a081_d840870c87a5.slice/crio-43895eec23b89e7633de9240e8d669a0b0d4116b2ac6764fb5ceee13adceebc3 WatchSource:0}: Error finding container 43895eec23b89e7633de9240e8d669a0b0d4116b2ac6764fb5ceee13adceebc3: Status 404 returned error can't find the container with id 43895eec23b89e7633de9240e8d669a0b0d4116b2ac6764fb5ceee13adceebc3
May 28 20:54:42.661642 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:42.661614    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb"]
May 28 20:54:42.664344 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:42.664314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3caa507_a541_48ed_ab50_362c1a100c04.slice/crio-d15b1d575032f0a9305a14efaef88b2de2ba8c4df17d0ddf5cbf41c969bb4185 WatchSource:0}: Error finding container d15b1d575032f0a9305a14efaef88b2de2ba8c4df17d0ddf5cbf41c969bb4185: Status 404 returned error can't find the container with id d15b1d575032f0a9305a14efaef88b2de2ba8c4df17d0ddf5cbf41c969bb4185
May 28 20:54:43.344474 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:43.344446    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb" event={"ID":"d3caa507-a541-48ed-ab50-362c1a100c04","Type":"ContainerStarted","Data":"4d7aaf075620fd9de65e5a36bb603bedcaf3d63e5a72b21d612482407deee01b"}
May 28 20:54:43.344557 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:43.344483    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb" event={"ID":"d3caa507-a541-48ed-ab50-362c1a100c04","Type":"ContainerStarted","Data":"a440cb1265b27fe454599524943c0c6359527a62da36f175d7e90b6a8bdff6b1"}
May 28 20:54:43.344557 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:43.344514    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb" event={"ID":"d3caa507-a541-48ed-ab50-362c1a100c04","Type":"ContainerStarted","Data":"d15b1d575032f0a9305a14efaef88b2de2ba8c4df17d0ddf5cbf41c969bb4185"}
May 28 20:54:43.346888 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:43.346825    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm" event={"ID":"80d8df27-47fb-4935-bcf6-ad6e8e51c986","Type":"ContainerStarted","Data":"a69cb9be89be269dfc0e66dcec510dd1f38118d1c7fda17a36d5bbd0309581c5"}
May 28 20:54:43.348122 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:43.348078    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q6wl" event={"ID":"e856df1b-d02a-4bf5-a081-d840870c87a5","Type":"ContainerStarted","Data":"43895eec23b89e7633de9240e8d669a0b0d4116b2ac6764fb5ceee13adceebc3"}
May 28 20:54:44.352656 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.352621    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb" event={"ID":"d3caa507-a541-48ed-ab50-362c1a100c04","Type":"ContainerStarted","Data":"fe4685808580ffa8c712d2e797a57cea7bc8609373d92e0e0a91b9f32ad9a545"}
May 28 20:54:44.354626 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.354603    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm" event={"ID":"80d8df27-47fb-4935-bcf6-ad6e8e51c986","Type":"ContainerStarted","Data":"ecad0c8474b0e8d1b6aa6af5da06fd6f08b7dc5135ef4ac7d00da9c7b159d97d"}
May 28 20:54:44.354733 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.354636    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm" event={"ID":"80d8df27-47fb-4935-bcf6-ad6e8e51c986","Type":"ContainerStarted","Data":"e7ce87def5e8f529e992c7f861a5cc2a7204b8daf8cf51a363b1b85c1fc664f5"}
May 28 20:54:44.356176 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.356152    2562 generic.go:358] "Generic (PLEG): container finished" podID="e856df1b-d02a-4bf5-a081-d840870c87a5" containerID="56549097de6174dd1459230ea8df8d16e69251489e99ee35e1c62ed610df76ae" exitCode=0
May 28 20:54:44.356271 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.356187    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q6wl" event={"ID":"e856df1b-d02a-4bf5-a081-d840870c87a5","Type":"ContainerDied","Data":"56549097de6174dd1459230ea8df8d16e69251489e99ee35e1c62ed610df76ae"}
May 28 20:54:44.371348 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.371289    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vc8pb" podStartSLOduration=2.144451321 podStartE2EDuration="3.371272777s" podCreationTimestamp="2026-05-28 20:54:41 +0000 UTC" firstStartedPulling="2026-05-28 20:54:42.819850993 +0000 UTC m=+128.497554400" lastFinishedPulling="2026-05-28 20:54:44.046672453 +0000 UTC m=+129.724375856" observedRunningTime="2026-05-28 20:54:44.370190874 +0000 UTC m=+130.047894296" watchObservedRunningTime="2026-05-28 20:54:44.371272777 +0000 UTC m=+130.048976200"
May 28 20:54:44.390435 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.390366    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8x9jm" podStartSLOduration=2.260556702 podStartE2EDuration="3.390348552s" podCreationTimestamp="2026-05-28 20:54:41 +0000 UTC" firstStartedPulling="2026-05-28 20:54:42.062822385 +0000 UTC m=+127.740525785" lastFinishedPulling="2026-05-28 20:54:43.192614234 +0000 UTC m=+128.870317635" observedRunningTime="2026-05-28 20:54:44.389044914 +0000 UTC m=+130.066748336" watchObservedRunningTime="2026-05-28 20:54:44.390348552 +0000 UTC m=+130.068051974"
May 28 20:54:44.684423 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.684345    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7649d8c475-bk5tf"]
May 28 20:54:44.687909 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.687889    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.690503 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.690482    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 20:54:44.690603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.690543    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 20:54:44.690843 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.690820    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 20:54:44.690980 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.690884    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 20:54:44.691109 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.691088    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fjzdk\""
May 28 20:54:44.691214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.691180    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8ek7qb2h61nmf\""
May 28 20:54:44.691281 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.691225    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 20:54:44.698400 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.698379    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7649d8c475-bk5tf"]
May 28 20:54:44.722098 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722211 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722211 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkvc\" (UniqueName: \"kubernetes.io/projected/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-kube-api-access-9fkvc\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-metrics-client-ca\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-grpc-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722470 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.722470 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722355    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:54:44.722470 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.722392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.724693 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.724677    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8610169-a367-44ba-9b7f-4be7849bdee6-metrics-certs\") pod \"network-metrics-daemon-j7n5k\" (UID: \"f8610169-a367-44ba-9b7f-4be7849bdee6\") " pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:54:44.732953 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.732936    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kbvdl\""
May 28 20:54:44.741460 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.741444    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7n5k"
May 28 20:54:44.823365 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823336    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkvc\" (UniqueName: \"kubernetes.io/projected/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-kube-api-access-9fkvc\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823399    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823444    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-metrics-client-ca\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823471    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-grpc-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823499    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823536    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823565    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.823713 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.823605    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.825377 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.824817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-metrics-client-ca\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.828513 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.828445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.829679 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.829626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.829825 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.829800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-grpc-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.830271 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.830249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-tls\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.830933 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.830882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.831841 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.831802    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.833038 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.833014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkvc\" (UniqueName: \"kubernetes.io/projected/db11bdf0-b4ac-4b7c-a930-7f78b4898c44-kube-api-access-9fkvc\") pod \"thanos-querier-7649d8c475-bk5tf\" (UID: \"db11bdf0-b4ac-4b7c-a930-7f78b4898c44\") " pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:44.873876 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.873850    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7n5k"]
May 28 20:54:44.876646 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:44.876622    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8610169_a367_44ba_9b7f_4be7849bdee6.slice/crio-682a41f23ce65d4812f1ff4da4bd969057dbf949e379a3e56bf44893a8e315c5 WatchSource:0}: Error finding container 682a41f23ce65d4812f1ff4da4bd969057dbf949e379a3e56bf44893a8e315c5: Status 404 returned error can't find the container with id 682a41f23ce65d4812f1ff4da4bd969057dbf949e379a3e56bf44893a8e315c5
May 28 20:54:44.997907 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:44.997842    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:45.132726 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.132693    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7649d8c475-bk5tf"]
May 28 20:54:45.135950 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:45.135920    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb11bdf0_b4ac_4b7c_a930_7f78b4898c44.slice/crio-266d328613e9e704a436c1539a2b5d79c55ce77b34be9da3e37e85ec5cc392b4 WatchSource:0}: Error finding container 266d328613e9e704a436c1539a2b5d79c55ce77b34be9da3e37e85ec5cc392b4: Status 404 returned error can't find the container with id 266d328613e9e704a436c1539a2b5d79c55ce77b34be9da3e37e85ec5cc392b4
May 28 20:54:45.364150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.364119    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q6wl" event={"ID":"e856df1b-d02a-4bf5-a081-d840870c87a5","Type":"ContainerStarted","Data":"6fe571d4cfffbab14992be1f19252124cfb23e779383db80e14d36ccb322ff84"}
May 28 20:54:45.364609 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.364159    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q6wl" event={"ID":"e856df1b-d02a-4bf5-a081-d840870c87a5","Type":"ContainerStarted","Data":"1029351558b50d7006da9022fd027cc2f03d62a3456cc91e57d335d4529cfa2a"}
May 28 20:54:45.365772 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.365719    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"266d328613e9e704a436c1539a2b5d79c55ce77b34be9da3e37e85ec5cc392b4"}
May 28 20:54:45.367187 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.367158    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7n5k" event={"ID":"f8610169-a367-44ba-9b7f-4be7849bdee6","Type":"ContainerStarted","Data":"682a41f23ce65d4812f1ff4da4bd969057dbf949e379a3e56bf44893a8e315c5"}
May 28 20:54:45.384503 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.384463    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4q6wl" podStartSLOduration=2.89338958 podStartE2EDuration="4.384446721s" podCreationTimestamp="2026-05-28 20:54:41 +0000 UTC" firstStartedPulling="2026-05-28 20:54:42.554568682 +0000 UTC m=+128.232272082" lastFinishedPulling="2026-05-28 20:54:44.045625814 +0000 UTC m=+129.723329223" observedRunningTime="2026-05-28 20:54:45.383663165 +0000 UTC m=+131.061366586" watchObservedRunningTime="2026-05-28 20:54:45.384446721 +0000 UTC m=+131.062150143"
May 28 20:54:45.913328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.913297    2562 scope.go:117] "RemoveContainer" containerID="77e75734380a1218843716bc73cd4521f298f79d2d22cbcc4845bc2c4632b648"
May 28 20:54:45.923072 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.923049    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d475698f5-rh2sw"]
May 28 20:54:45.925281 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.925255    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:45.929136 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929113    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-564dj\""
May 28 20:54:45.929247 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929153    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 20:54:45.929247 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929116    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 20:54:45.929351 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929261    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 20:54:45.929412 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929381    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-37790eob2js0j\""
May 28 20:54:45.929460 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.929429    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 20:54:45.936127 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:45.936106    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d475698f5-rh2sw"]
May 28 20:54:46.035332 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-client-certs\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035430 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035466 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-tls\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035509 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvdq\" (UniqueName: \"kubernetes.io/projected/80ba73d1-157f-42ee-97b6-828275e2f92e-kube-api-access-bgvdq\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035570 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-metrics-server-audit-profiles\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035618 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80ba73d1-157f-42ee-97b6-828275e2f92e-audit-log\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.035833 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.035643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-client-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.136818 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136791    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-metrics-server-audit-profiles\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.136925 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136832    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80ba73d1-157f-42ee-97b6-828275e2f92e-audit-log\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.136925 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136857    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-client-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.136925 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136920    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-client-certs\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.137036 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136949    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.137036 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.136982    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-tls\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.137036 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.137023    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvdq\" (UniqueName: \"kubernetes.io/projected/80ba73d1-157f-42ee-97b6-828275e2f92e-kube-api-access-bgvdq\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.138384 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.138077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80ba73d1-157f-42ee-97b6-828275e2f92e-audit-log\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.138384 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.138167    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.139304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.139279    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80ba73d1-157f-42ee-97b6-828275e2f92e-metrics-server-audit-profiles\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.140785 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.140716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-client-ca-bundle\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.140915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.140895    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-client-certs\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.141286 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.141266    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80ba73d1-157f-42ee-97b6-828275e2f92e-secret-metrics-server-tls\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.145098 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.145077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvdq\" (UniqueName: \"kubernetes.io/projected/80ba73d1-157f-42ee-97b6-828275e2f92e-kube-api-access-bgvdq\") pod \"metrics-server-7d475698f5-rh2sw\" (UID: \"80ba73d1-157f-42ee-97b6-828275e2f92e\") " pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.258765 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.258664    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:54:46.376958 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.374400    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 20:54:46.376958 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.374511    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" event={"ID":"591a44ff-c166-40aa-bdfb-1f8b444dd0b1","Type":"ContainerStarted","Data":"0c83780ae4d996c38bda19976698de7d59018436564ef876c44e7df7ddfd47dc"}
May 28 20:54:46.376958 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.376341    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:46.383180 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.382285    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7n5k" event={"ID":"f8610169-a367-44ba-9b7f-4be7849bdee6","Type":"ContainerStarted","Data":"e25830c3c382699b62c4647a1f5ece2a42e6eee2eabe6960f94018a377327bd5"}
May 28 20:54:46.383180 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.382314    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7n5k" event={"ID":"f8610169-a367-44ba-9b7f-4be7849bdee6","Type":"ContainerStarted","Data":"cd94ad9600c906dc8e9a12384a87660f4c573a569bce528d9c13ba1ebf2a3997"}
May 28 20:54:46.395669 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.395449    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-t28r6" podStartSLOduration=45.240979031 podStartE2EDuration="47.395432042s" podCreationTimestamp="2026-05-28 20:53:59 +0000 UTC" firstStartedPulling="2026-05-28 20:53:59.516922865 +0000 UTC m=+85.194626264" lastFinishedPulling="2026-05-28 20:54:01.671375874 +0000 UTC m=+87.349079275" observedRunningTime="2026-05-28 20:54:46.394419197 +0000 UTC m=+132.072122620" watchObservedRunningTime="2026-05-28 20:54:46.395432042 +0000 UTC m=+132.073135464"
May 28 20:54:46.423270 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.423224    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j7n5k" podStartSLOduration=130.351125619 podStartE2EDuration="2m11.423203951s" podCreationTimestamp="2026-05-28 20:52:35 +0000 UTC" firstStartedPulling="2026-05-28 20:54:44.87843173 +0000 UTC m=+130.556135129" lastFinishedPulling="2026-05-28 20:54:45.950510046 +0000 UTC m=+131.628213461" observedRunningTime="2026-05-28 20:54:46.420296343 +0000 UTC m=+132.097999775" watchObservedRunningTime="2026-05-28 20:54:46.423203951 +0000 UTC m=+132.100907375"
May 28 20:54:46.436897 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.436837    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d475698f5-rh2sw"]
May 28 20:54:46.442459 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:46.442431    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ba73d1_157f_42ee_97b6_828275e2f92e.slice/crio-527dc619b79bec33187898361348be227c4bceef3cd779196373a52967ad335e WatchSource:0}: Error finding container 527dc619b79bec33187898361348be227c4bceef3cd779196373a52967ad335e: Status 404 returned error can't find the container with id 527dc619b79bec33187898361348be227c4bceef3cd779196373a52967ad335e
May 28 20:54:46.754465 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:46.754435    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-t28r6"
May 28 20:54:47.385610 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:47.385569    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw" event={"ID":"80ba73d1-157f-42ee-97b6-828275e2f92e","Type":"ContainerStarted","Data":"527dc619b79bec33187898361348be227c4bceef3cd779196373a52967ad335e"}
May 28 20:54:47.387585 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:47.387556    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"2ccec472ce986d0cd5744242062113b59c990904df0fc994b564ddd89ab56f11"}
May 28 20:54:47.387720 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:47.387592    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"7aa1d8132b2e650bb10d2a5da409c34267e0fa839872a5867f381987949548a4"}
May 28 20:54:47.387720 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:47.387609    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"61513a813219cfa0303f6382e3a1f3da51ed70cd409ccb25a67415c02f11be24"}
May 28 20:54:48.300644 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.300625    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8976b64d5-xm7jc"
May 28 20:54:48.393706 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.393670    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw" event={"ID":"80ba73d1-157f-42ee-97b6-828275e2f92e","Type":"ContainerStarted","Data":"dbc7bec6dd2b7362f5b0421540be389d821f6983e7ca82c7a6be7d762823e889"}
May 28 20:54:48.397500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.397446    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"c6f99c7126846e4b6fa4362fb1fd3b7bab9b1e825cdadcf458e361f26e33a38a"}
May 28 20:54:48.397500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.397483    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"2e6bd18c9632e8b29a8bf3b1001b965b5e7831f40da384900f477bb80cad22d6"}
May 28 20:54:48.397500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.397498    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" event={"ID":"db11bdf0-b4ac-4b7c-a930-7f78b4898c44","Type":"ContainerStarted","Data":"b737b5adb8f6d89e434dd774f6f270c95cf2115e212a098895ba97ce43294a6b"}
May 28 20:54:48.397651 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.397517    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:48.431516 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.431469    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf" podStartSLOduration=1.733924988 podStartE2EDuration="4.431456825s" podCreationTimestamp="2026-05-28 20:54:44 +0000 UTC" firstStartedPulling="2026-05-28 20:54:45.137934382 +0000 UTC m=+130.815637781" lastFinishedPulling="2026-05-28 20:54:47.835466205 +0000 UTC m=+133.513169618" observedRunningTime="2026-05-28 20:54:48.429842688 +0000 UTC m=+134.107546109" watchObservedRunningTime="2026-05-28 20:54:48.431456825 +0000 UTC m=+134.109160298"
May 28 20:54:48.432255 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:48.432219    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw" podStartSLOduration=1.586545015 podStartE2EDuration="3.432210608s" podCreationTimestamp="2026-05-28 20:54:45 +0000 UTC" firstStartedPulling="2026-05-28 20:54:46.445009261 +0000 UTC m=+132.122712665" lastFinishedPulling="2026-05-28 20:54:48.290674851 +0000 UTC m=+133.968378258" observedRunningTime="2026-05-28 20:54:48.410422017 +0000 UTC m=+134.088125438" watchObservedRunningTime="2026-05-28 20:54:48.432210608 +0000 UTC m=+134.109914028"
May 28 20:54:51.247804 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.247722    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" podUID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" containerName="registry" containerID="cri-o://603d877f001c23adb24fe921cad0a6857a887a1863c1633be414a6c298775b89" gracePeriod=30
May 28 20:54:51.407971 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.407938    2562 generic.go:358] "Generic (PLEG): container finished" podID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" containerID="603d877f001c23adb24fe921cad0a6857a887a1863c1633be414a6c298775b89" exitCode=0
May 28 20:54:51.408107 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.408014    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" event={"ID":"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5","Type":"ContainerDied","Data":"603d877f001c23adb24fe921cad0a6857a887a1863c1633be414a6c298775b89"}
May 28 20:54:51.483778 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.483739    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:51.587143 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587075    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587143 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587115    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587143 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587141    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587352 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587160    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxlct\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587352 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587188    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587352 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587258    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587352 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587308    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587524 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587390    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration\") pod \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\" (UID: \"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5\") "
May 28 20:54:51.587574 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587556    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:54:51.587627 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587583    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:54:51.587715 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587697    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-trusted-ca\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.587803 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.587721    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-certificates\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.589826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.589781    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:54:51.589938 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.589851    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct" (OuterVolumeSpecName: "kube-api-access-nxlct") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "kube-api-access-nxlct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:54:51.590098 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.590062    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:54:51.590162 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.590104    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:54:51.590201 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.590153    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:54:51.596418 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.596396    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" (UID: "87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:54:51.688905 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688877    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-registry-tls\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.688905 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688900    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxlct\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-kube-api-access-nxlct\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.688905 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688910    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-ca-trust-extracted\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.689069 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688919    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-bound-sa-token\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.689069 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688928    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-installation-pull-secrets\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:51.689069 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:51.688939    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5-image-registry-private-configuration\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:54:52.412342 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.412308    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk" event={"ID":"87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5","Type":"ContainerDied","Data":"a3d47546127f614c6d402ea738ff2d374e10f08174fedf2d8b3d2f1d213b3221"}
May 28 20:54:52.412342 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.412348    2562 scope.go:117] "RemoveContainer" containerID="603d877f001c23adb24fe921cad0a6857a887a1863c1633be414a6c298775b89"
May 28 20:54:52.412848 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.412348    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4479bbf4-7t4hk"
May 28 20:54:52.432518 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.432496    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:54:52.436512 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.436492    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b4479bbf4-7t4hk"]
May 28 20:54:52.917184 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:52.917145    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" path="/var/lib/kubelet/pods/87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5/volumes"
May 28 20:54:54.406037 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:54.406012    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7649d8c475-bk5tf"
May 28 20:54:57.455564 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.455534    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:54:57.455968 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.455838    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" containerName="registry"
May 28 20:54:57.455968 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.455851    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" containerName="registry"
May 28 20:54:57.455968 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.455901    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="87a2be6e-0fa5-4d0b-a441-13b4cffa8fb5" containerName="registry"
May 28 20:54:57.458790 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.458770    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.461366 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.461340    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 20:54:57.461475 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.461340    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 20:54:57.461475 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.461340    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 20:54:57.462516 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.462497    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 20:54:57.462610 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.462551    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 20:54:57.462610 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.462502    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 20:54:57.462610 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.462497    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 20:54:57.462610 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.462604    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rnhm5\""
May 28 20:54:57.466296 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.466271    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:54:57.535187 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.535304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.535304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.535304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.535392 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.535392 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.535345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4qs\" (UniqueName: \"kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636506 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636479    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636506 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636508    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636660 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636542    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636660 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636559    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636660 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636594    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.636660 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.636626    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4qs\" (UniqueName: \"kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.637229 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.637210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.637485 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.637343    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.637485 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.637373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.638997 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.638970    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.639108 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.639090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.644005 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.643987    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4qs\" (UniqueName: \"kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs\") pod \"console-85fb78b797-czsxq\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") " pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.769137 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.769066    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:54:57.890869 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:57.890706    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:54:57.892997 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:54:57.892974    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b6beae_0007_422d_a2b4_35d568063863.slice/crio-ef08fa589b577b6ffc64dd327480e3812b574a799a796f964577c6206db0531e WatchSource:0}: Error finding container ef08fa589b577b6ffc64dd327480e3812b574a799a796f964577c6206db0531e: Status 404 returned error can't find the container with id ef08fa589b577b6ffc64dd327480e3812b574a799a796f964577c6206db0531e
May 28 20:54:58.433823 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:54:58.433787    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb78b797-czsxq" event={"ID":"09b6beae-0007-422d-a2b4-35d568063863","Type":"ContainerStarted","Data":"ef08fa589b577b6ffc64dd327480e3812b574a799a796f964577c6206db0531e"}
May 28 20:55:01.444718 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:01.444680    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb78b797-czsxq" event={"ID":"09b6beae-0007-422d-a2b4-35d568063863","Type":"ContainerStarted","Data":"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"}
May 28 20:55:01.461648 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:01.461602    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85fb78b797-czsxq" podStartSLOduration=1.5681903149999998 podStartE2EDuration="4.461584702s" podCreationTimestamp="2026-05-28 20:54:57 +0000 UTC" firstStartedPulling="2026-05-28 20:54:57.894940697 +0000 UTC m=+143.572644096" lastFinishedPulling="2026-05-28 20:55:00.788335085 +0000 UTC m=+146.466038483" observedRunningTime="2026-05-28 20:55:01.460368933 +0000 UTC m=+147.138072351" watchObservedRunningTime="2026-05-28 20:55:01.461584702 +0000 UTC m=+147.139288122"
May 28 20:55:06.242367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.242338    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:55:06.254438 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.254413    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.255427 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.255401    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:55:06.258735 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.258711    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:55:06.258872 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.258805    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:55:06.262431 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.262409    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 20:55:06.309175 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309268 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxgs5\" (UniqueName: \"kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309268 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309268 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.309363 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.309348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410051 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410020    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410051 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410052    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410344 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410320    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410558 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410534    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxgs5\" (UniqueName: \"kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410667 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410593    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410667 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410645    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410802 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410712    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410802 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.410903 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.410821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.411235 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.411200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.411319 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.411301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.412999 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.412982    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.413095 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.413079    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.418331 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.418314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxgs5\" (UniqueName: \"kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5\") pod \"console-7cddffff9c-vr8p2\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") " pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.565391 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.565306    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:06.709856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:06.709830    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:55:06.711588 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:55:06.711551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b241aa_d72c_4e6b_b740_23839ce923a8.slice/crio-54c3580cbc9c9f56fd2ab1cc54bd50f51f3314384eef60dd66b47a34da0c8947 WatchSource:0}: Error finding container 54c3580cbc9c9f56fd2ab1cc54bd50f51f3314384eef60dd66b47a34da0c8947: Status 404 returned error can't find the container with id 54c3580cbc9c9f56fd2ab1cc54bd50f51f3314384eef60dd66b47a34da0c8947
May 28 20:55:07.463719 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.463504    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cddffff9c-vr8p2" event={"ID":"98b241aa-d72c-4e6b-b740-23839ce923a8","Type":"ContainerStarted","Data":"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"}
May 28 20:55:07.463719 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.463578    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cddffff9c-vr8p2" event={"ID":"98b241aa-d72c-4e6b-b740-23839ce923a8","Type":"ContainerStarted","Data":"54c3580cbc9c9f56fd2ab1cc54bd50f51f3314384eef60dd66b47a34da0c8947"}
May 28 20:55:07.481627 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.481574    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7cddffff9c-vr8p2" podStartSLOduration=1.48155901 podStartE2EDuration="1.48155901s" podCreationTimestamp="2026-05-28 20:55:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:55:07.480694282 +0000 UTC m=+153.158397704" watchObservedRunningTime="2026-05-28 20:55:07.48155901 +0000 UTC m=+153.159262431"
May 28 20:55:07.769800 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.769697    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:07.769800 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.769739    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:07.774492 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:07.774471    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:08.469675 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:08.469645    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:11.785869 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:55:11.785829    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-v5vst" podUID="cd1ae37a-66c4-4ae8-9bed-4b33783a50b2"
May 28 20:55:12.476508 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:12.476479    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:55:16.565462 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.565435    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:16.565852 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.565478    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:16.570036 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.570013    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:16.697594 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.697564    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:55:16.700043 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.700023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd1ae37a-66c4-4ae8-9bed-4b33783a50b2-cert\") pod \"ingress-canary-v5vst\" (UID: \"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2\") " pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:55:16.979171 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.979141    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gngfj\""
May 28 20:55:16.987119 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:16.987094    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v5vst"
May 28 20:55:17.114162 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:17.114111    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v5vst"]
May 28 20:55:17.116669 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:55:17.116641    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1ae37a_66c4_4ae8_9bed_4b33783a50b2.slice/crio-9bdf6a83e6251100f914df70d449fa3d037697d081cf0e8ed00062cf551775ce WatchSource:0}: Error finding container 9bdf6a83e6251100f914df70d449fa3d037697d081cf0e8ed00062cf551775ce: Status 404 returned error can't find the container with id 9bdf6a83e6251100f914df70d449fa3d037697d081cf0e8ed00062cf551775ce
May 28 20:55:17.489681 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:17.489644    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v5vst" event={"ID":"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2","Type":"ContainerStarted","Data":"9bdf6a83e6251100f914df70d449fa3d037697d081cf0e8ed00062cf551775ce"}
May 28 20:55:17.493530 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:17.493508    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:55:17.538321 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:17.538285    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:55:19.496873 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:19.496785    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v5vst" event={"ID":"cd1ae37a-66c4-4ae8-9bed-4b33783a50b2","Type":"ContainerStarted","Data":"87762a7b88b7323a4c09f66716835f0677ade707088a924a2912ec1b48df6421"}
May 28 20:55:19.512876 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:19.512830    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v5vst" podStartSLOduration=129.515912022 podStartE2EDuration="2m11.5128155s" podCreationTimestamp="2026-05-28 20:53:08 +0000 UTC" firstStartedPulling="2026-05-28 20:55:17.118590409 +0000 UTC m=+162.796293808" lastFinishedPulling="2026-05-28 20:55:19.115493887 +0000 UTC m=+164.793197286" observedRunningTime="2026-05-28 20:55:19.51183537 +0000 UTC m=+165.189538791" watchObservedRunningTime="2026-05-28 20:55:19.5128155 +0000 UTC m=+165.190518922"
May 28 20:55:26.264393 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:26.264318    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:55:26.268390 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:26.268362    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d475698f5-rh2sw"
May 28 20:55:38.551588 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:38.551550    2562 generic.go:358] "Generic (PLEG): container finished" podID="1169c1ed-2cd3-4627-b491-a282b93c71b7" containerID="b50fc3d717f60dbcd0b290f393399e52a2520e6a8ccaafc9b44542e93507fcd4" exitCode=0
May 28 20:55:38.552158 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:38.551627    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p" event={"ID":"1169c1ed-2cd3-4627-b491-a282b93c71b7","Type":"ContainerDied","Data":"b50fc3d717f60dbcd0b290f393399e52a2520e6a8ccaafc9b44542e93507fcd4"}
May 28 20:55:38.552158 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:38.552053    2562 scope.go:117] "RemoveContainer" containerID="b50fc3d717f60dbcd0b290f393399e52a2520e6a8ccaafc9b44542e93507fcd4"
May 28 20:55:39.555950 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:39.555916    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fbw9p" event={"ID":"1169c1ed-2cd3-4627-b491-a282b93c71b7","Type":"ContainerStarted","Data":"8c8885670d92d362d0d6fb142831a8e9b98fb1007d6d09b098992ca6d5f7e5b1"}
May 28 20:55:42.565865 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.565827    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-85fb78b797-czsxq" podUID="09b6beae-0007-422d-a2b4-35d568063863" containerName="console" containerID="cri-o://d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5" gracePeriod=15
May 28 20:55:42.801386 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.801361    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85fb78b797-czsxq_09b6beae-0007-422d-a2b4-35d568063863/console/0.log"
May 28 20:55:42.801491 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.801434    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:42.889766 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889720    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.889766 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889761    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.890021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889806    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.890021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889841    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.890021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889868    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh4qs\" (UniqueName: \"kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.890021 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.889888    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert\") pod \"09b6beae-0007-422d-a2b4-35d568063863\" (UID: \"09b6beae-0007-422d-a2b4-35d568063863\") "
May 28 20:55:42.890226 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.890197    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:55:42.890282 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.890260    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca" (OuterVolumeSpecName: "service-ca") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:55:42.890520 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.890497    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config" (OuterVolumeSpecName: "console-config") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:55:42.892242 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.892206    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs" (OuterVolumeSpecName: "kube-api-access-xh4qs") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "kube-api-access-xh4qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:55:42.892242 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.892219    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:55:42.892388 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.892308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09b6beae-0007-422d-a2b4-35d568063863" (UID: "09b6beae-0007-422d-a2b4-35d568063863"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:55:42.990523 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990493    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-service-ca\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:42.990523 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990519    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-oauth-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:42.990670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990529    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh4qs\" (UniqueName: \"kubernetes.io/projected/09b6beae-0007-422d-a2b4-35d568063863-kube-api-access-xh4qs\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:42.990670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990538    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09b6beae-0007-422d-a2b4-35d568063863-console-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:42.990670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990546    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-oauth-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:42.990670 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:42.990556    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09b6beae-0007-422d-a2b4-35d568063863-console-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:55:43.568973 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.568946    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85fb78b797-czsxq_09b6beae-0007-422d-a2b4-35d568063863/console/0.log"
May 28 20:55:43.569367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.568990    2562 generic.go:358] "Generic (PLEG): container finished" podID="09b6beae-0007-422d-a2b4-35d568063863" containerID="d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5" exitCode=2
May 28 20:55:43.569367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.569064    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb78b797-czsxq" event={"ID":"09b6beae-0007-422d-a2b4-35d568063863","Type":"ContainerDied","Data":"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"}
May 28 20:55:43.569367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.569087    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb78b797-czsxq"
May 28 20:55:43.569367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.569101    2562 scope.go:117] "RemoveContainer" containerID="d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"
May 28 20:55:43.569367 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.569091    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb78b797-czsxq" event={"ID":"09b6beae-0007-422d-a2b4-35d568063863","Type":"ContainerDied","Data":"ef08fa589b577b6ffc64dd327480e3812b574a799a796f964577c6206db0531e"}
May 28 20:55:43.577197 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.577176    2562 scope.go:117] "RemoveContainer" containerID="d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"
May 28 20:55:43.577456 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:55:43.577431    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5\": container with ID starting with d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5 not found: ID does not exist" containerID="d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"
May 28 20:55:43.577511 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.577463    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5"} err="failed to get container status \"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5\": rpc error: code = NotFound desc = could not find container \"d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5\": container with ID starting with d411459e1397d7c0d398b029eb0bfbb506de6b35a54452d860294e8ac4a9f8c5 not found: ID does not exist"
May 28 20:55:43.585862 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.585842    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:55:43.588985 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:43.588966    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fb78b797-czsxq"]
May 28 20:55:44.916262 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:55:44.916226    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b6beae-0007-422d-a2b4-35d568063863" path="/var/lib/kubelet/pods/09b6beae-0007-422d-a2b4-35d568063863/volumes"
May 28 20:56:05.926456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.926413    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-698d4997-pcc24"]
May 28 20:56:05.926964 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.926727    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b6beae-0007-422d-a2b4-35d568063863" containerName="console"
May 28 20:56:05.926964 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.926739    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b6beae-0007-422d-a2b4-35d568063863" containerName="console"
May 28 20:56:05.926964 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.926820    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="09b6beae-0007-422d-a2b4-35d568063863" containerName="console"
May 28 20:56:05.928815 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.928796    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:05.931718 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.931692    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 20:56:05.931883 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.931778    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 20:56:05.931883 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.931683    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 20:56:05.931883 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.931876    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 20:56:05.932058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.931849    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6b8jd\""
May 28 20:56:05.932914 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.932899    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 20:56:05.937956 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.937934    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 20:56:05.942356 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:05.942332    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698d4997-pcc24"]
May 28 20:56:06.061291 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-metrics-client-ca\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8j5w\" (UniqueName: \"kubernetes.io/projected/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-kube-api-access-v8j5w\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-serving-certs-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-federate-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061586 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061586 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.061586 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.061528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162379 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162345    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162388    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-metrics-client-ca\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162409    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8j5w\" (UniqueName: \"kubernetes.io/projected/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-kube-api-access-v8j5w\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162429    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-serving-certs-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162453    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-federate-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162500    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162837 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162533    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.162837 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.162561    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.163208 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.163186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-metrics-client-ca\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.163309 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.163186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-serving-certs-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.163668 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.163642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.165100 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.165076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.165280 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.165188    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.165556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.165536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-telemeter-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.165657 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.165638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-federate-client-tls\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.170333 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.170318    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8j5w\" (UniqueName: \"kubernetes.io/projected/fd10bc6a-2bf7-48b4-87bd-80fccc174cdb-kube-api-access-v8j5w\") pod \"telemeter-client-698d4997-pcc24\" (UID: \"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb\") " pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.239683 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.239614    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698d4997-pcc24"
May 28 20:56:06.373200 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.373163    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698d4997-pcc24"]
May 28 20:56:06.376361 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:56:06.376328    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd10bc6a_2bf7_48b4_87bd_80fccc174cdb.slice/crio-9921c5115df8c7d0d1b9395960cca9978233ad3643b9f72a1772a0234d894238 WatchSource:0}: Error finding container 9921c5115df8c7d0d1b9395960cca9978233ad3643b9f72a1772a0234d894238: Status 404 returned error can't find the container with id 9921c5115df8c7d0d1b9395960cca9978233ad3643b9f72a1772a0234d894238
May 28 20:56:06.640587 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:06.640550    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d4997-pcc24" event={"ID":"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb","Type":"ContainerStarted","Data":"9921c5115df8c7d0d1b9395960cca9978233ad3643b9f72a1772a0234d894238"}
May 28 20:56:08.648208 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:08.648171    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d4997-pcc24" event={"ID":"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb","Type":"ContainerStarted","Data":"f8b85e07ec253736c483e70bc42147cc1d4f18312699e2e974a27ba23f9106d3"}
May 28 20:56:09.652844 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:09.652811    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d4997-pcc24" event={"ID":"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb","Type":"ContainerStarted","Data":"354302214dfc2c1dc32eea8142d25f650ad60fcc9de823d09461b799457e0d53"}
May 28 20:56:09.652844 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:09.652845    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d4997-pcc24" event={"ID":"fd10bc6a-2bf7-48b4-87bd-80fccc174cdb","Type":"ContainerStarted","Data":"bd611bc50a482d70c21a996d50b058b34c0c1c5cc2835ba53ee010d1c0f7de01"}
May 28 20:56:09.675247 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:09.675203    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-698d4997-pcc24" podStartSLOduration=1.60356705 podStartE2EDuration="4.67519054s" podCreationTimestamp="2026-05-28 20:56:05 +0000 UTC" firstStartedPulling="2026-05-28 20:56:06.378377236 +0000 UTC m=+212.056080634" lastFinishedPulling="2026-05-28 20:56:09.450000721 +0000 UTC m=+215.127704124" observedRunningTime="2026-05-28 20:56:09.673818525 +0000 UTC m=+215.351521947" watchObservedRunningTime="2026-05-28 20:56:09.67519054 +0000 UTC m=+215.352893957"
May 28 20:56:10.415653 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.415602    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:56:10.418502 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.418466    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.428733 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.428708    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:56:10.496841 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.496810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.496992 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.496860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.496992 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.496891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.496992 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.496914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.496992 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.496948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.497194 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.497050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.497194 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.497102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7cds\" (UniqueName: \"kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.597987 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.597954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598125 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.597992    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598125 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598018    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598133    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598179    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598386 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598233    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598386 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598261    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7cds\" (UniqueName: \"kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.598940 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598911    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.599071 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.598968    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.599189 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.599171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.599262 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.599240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.600652 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.600623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.600744 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.600668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.605865 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.605844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7cds\" (UniqueName: \"kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds\") pod \"console-85f9c89f86-wp72r\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") " pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.727728 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.727673    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:10.851542 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:10.851516    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:56:10.854206 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:56:10.854181    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d26059_df5c_4a0a_9fca_0e4ed50df470.slice/crio-98fb097f973cdb4f118d4e31908884443c857824463cc99c3a9fe88329195969 WatchSource:0}: Error finding container 98fb097f973cdb4f118d4e31908884443c857824463cc99c3a9fe88329195969: Status 404 returned error can't find the container with id 98fb097f973cdb4f118d4e31908884443c857824463cc99c3a9fe88329195969
May 28 20:56:11.660234 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:11.660202    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c89f86-wp72r" event={"ID":"b4d26059-df5c-4a0a-9fca-0e4ed50df470","Type":"ContainerStarted","Data":"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"}
May 28 20:56:11.660468 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:11.660241    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c89f86-wp72r" event={"ID":"b4d26059-df5c-4a0a-9fca-0e4ed50df470","Type":"ContainerStarted","Data":"98fb097f973cdb4f118d4e31908884443c857824463cc99c3a9fe88329195969"}
May 28 20:56:11.678493 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:11.678436    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85f9c89f86-wp72r" podStartSLOduration=1.6784225149999998 podStartE2EDuration="1.678422515s" podCreationTimestamp="2026-05-28 20:56:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:56:11.676508284 +0000 UTC m=+217.354211706" watchObservedRunningTime="2026-05-28 20:56:11.678422515 +0000 UTC m=+217.356125936"
May 28 20:56:20.728531 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:20.728499    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:20.729015 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:20.728644    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:20.733387 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:20.733368    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:21.693881 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:21.693854    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:56:21.738466 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:21.738427    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:56:46.758105 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:46.758043    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7cddffff9c-vr8p2" podUID="98b241aa-d72c-4e6b-b740-23839ce923a8" containerName="console" containerID="cri-o://633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752" gracePeriod=15
May 28 20:56:47.001729 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.001709    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cddffff9c-vr8p2_98b241aa-d72c-4e6b-b740-23839ce923a8/console/0.log"
May 28 20:56:47.001849 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.001792    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:56:47.180240 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180208    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180424 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180252    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180424 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180270    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180459    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxgs5\" (UniqueName: \"kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180493    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180548 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180520    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180705 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180548    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert\") pod \"98b241aa-d72c-4e6b-b740-23839ce923a8\" (UID: \"98b241aa-d72c-4e6b-b740-23839ce923a8\") "
May 28 20:56:47.180705 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180672    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:56:47.181011 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180983    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:56:47.181011 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.180993    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config" (OuterVolumeSpecName: "console-config") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:56:47.181276 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.181248    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:56:47.181507 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.181489    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-oauth-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.181558 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.181516    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-trusted-ca-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.181558 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.181531    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-service-ca\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.181558 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.181548    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b241aa-d72c-4e6b-b740-23839ce923a8-console-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.182640 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.182617    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:56:47.182791 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.182743    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:56:47.182907 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.182863    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5" (OuterVolumeSpecName: "kube-api-access-xxgs5") pod "98b241aa-d72c-4e6b-b740-23839ce923a8" (UID: "98b241aa-d72c-4e6b-b740-23839ce923a8"). InnerVolumeSpecName "kube-api-access-xxgs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:56:47.281932 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.281908    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.281932 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.281930    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b241aa-d72c-4e6b-b740-23839ce923a8-console-oauth-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.282067 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.281940    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxgs5\" (UniqueName: \"kubernetes.io/projected/98b241aa-d72c-4e6b-b740-23839ce923a8-kube-api-access-xxgs5\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:56:47.766586 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766558    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cddffff9c-vr8p2_98b241aa-d72c-4e6b-b740-23839ce923a8/console/0.log"
May 28 20:56:47.767020 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766602    2562 generic.go:358] "Generic (PLEG): container finished" podID="98b241aa-d72c-4e6b-b740-23839ce923a8" containerID="633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752" exitCode=2
May 28 20:56:47.767020 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766674    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cddffff9c-vr8p2"
May 28 20:56:47.767020 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766695    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cddffff9c-vr8p2" event={"ID":"98b241aa-d72c-4e6b-b740-23839ce923a8","Type":"ContainerDied","Data":"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"}
May 28 20:56:47.767020 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766734    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cddffff9c-vr8p2" event={"ID":"98b241aa-d72c-4e6b-b740-23839ce923a8","Type":"ContainerDied","Data":"54c3580cbc9c9f56fd2ab1cc54bd50f51f3314384eef60dd66b47a34da0c8947"}
May 28 20:56:47.767020 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.766762    2562 scope.go:117] "RemoveContainer" containerID="633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"
May 28 20:56:47.774966 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.774950    2562 scope.go:117] "RemoveContainer" containerID="633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"
May 28 20:56:47.775230 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:56:47.775210    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752\": container with ID starting with 633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752 not found: ID does not exist" containerID="633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"
May 28 20:56:47.775277 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.775237    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752"} err="failed to get container status \"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752\": rpc error: code = NotFound desc = could not find container \"633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752\": container with ID starting with 633e6791d9da3d31175ceb6174ccb8375aecf0744280075a0c7ec00c86c0a752 not found: ID does not exist"
May 28 20:56:47.788284 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.788258    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:56:47.795715 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:47.795695    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cddffff9c-vr8p2"]
May 28 20:56:48.916016 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:56:48.915985    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98b241aa-d72c-4e6b-b740-23839ce923a8" path="/var/lib/kubelet/pods/98b241aa-d72c-4e6b-b740-23839ce923a8/volumes"
May 28 20:57:31.135434 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.135389    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 20:57:31.135944 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.135892    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b241aa-d72c-4e6b-b740-23839ce923a8" containerName="console"
May 28 20:57:31.135944 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.135909    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b241aa-d72c-4e6b-b740-23839ce923a8" containerName="console"
May 28 20:57:31.136030 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.135963    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="98b241aa-d72c-4e6b-b740-23839ce923a8" containerName="console"
May 28 20:57:31.138623 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.138604    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.149264 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.149240    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 20:57:31.216564 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216683 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216683 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216683 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdcvq\" (UniqueName: \"kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216683 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216851 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.216851 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.216769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317496 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317465    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317496 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317499    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317681 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317525    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317681 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317573    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317799 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317799 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317774    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.317904 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.317801    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdcvq\" (UniqueName: \"kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.318332 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.318311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.318439 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.318412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.318439 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.318422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.318575 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.318557    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.320613 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.320583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.320699 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.320658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.325797 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.325782    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdcvq\" (UniqueName: \"kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq\") pod \"console-844796c6d7-g55g2\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") " pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.449272 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.449212    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:31.581889 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.581862    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 20:57:31.584336 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:57:31.584307    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5929abf3_8f49_45d5_91e7_1a6a53175948.slice/crio-15dbd814edf4dd3a380778d1ffbaea7f739fdde301e173e727e0ed360338a567 WatchSource:0}: Error finding container 15dbd814edf4dd3a380778d1ffbaea7f739fdde301e173e727e0ed360338a567: Status 404 returned error can't find the container with id 15dbd814edf4dd3a380778d1ffbaea7f739fdde301e173e727e0ed360338a567
May 28 20:57:31.890825 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.890789    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844796c6d7-g55g2" event={"ID":"5929abf3-8f49-45d5-91e7-1a6a53175948","Type":"ContainerStarted","Data":"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"}
May 28 20:57:31.890977 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.890833    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844796c6d7-g55g2" event={"ID":"5929abf3-8f49-45d5-91e7-1a6a53175948","Type":"ContainerStarted","Data":"15dbd814edf4dd3a380778d1ffbaea7f739fdde301e173e727e0ed360338a567"}
May 28 20:57:31.909131 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:31.909087    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-844796c6d7-g55g2" podStartSLOduration=0.909074719 podStartE2EDuration="909.074719ms" podCreationTimestamp="2026-05-28 20:57:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:57:31.907709523 +0000 UTC m=+297.585412968" watchObservedRunningTime="2026-05-28 20:57:31.909074719 +0000 UTC m=+297.586778139"
May 28 20:57:34.770172 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:34.770139    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 20:57:34.771092 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:34.771073    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 20:57:34.786627 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:34.786607    2562 kubelet.go:1628] "Image garbage collection succeeded"
May 28 20:57:41.450135 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:41.450093    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:41.450135 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:41.450143    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:41.454542 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:41.454523    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:41.924611 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:41.924579    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844796c6d7-g55g2"
May 28 20:57:41.975644 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:57:41.975610    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:58:06.995795 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:06.995718    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-85f9c89f86-wp72r" podUID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" containerName="console" containerID="cri-o://238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817" gracePeriod=15
May 28 20:58:07.238313 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.238293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85f9c89f86-wp72r_b4d26059-df5c-4a0a-9fca-0e4ed50df470/console/0.log"
May 28 20:58:07.238432 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.238350    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:58:07.302245 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302176    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302245 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302217    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302245 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302241    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302263    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302315    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7cds\" (UniqueName: \"kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302337    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302456 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302376    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca\") pod \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\" (UID: \"b4d26059-df5c-4a0a-9fca-0e4ed50df470\") "
May 28 20:58:07.302648 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302601    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:58:07.302825 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302795    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:58:07.302949 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302838    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config" (OuterVolumeSpecName: "console-config") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:58:07.302949 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.302893    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:58:07.304502 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.304481    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:58:07.305159 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.305127    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:58:07.305236 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.305158    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds" (OuterVolumeSpecName: "kube-api-access-k7cds") pod "b4d26059-df5c-4a0a-9fca-0e4ed50df470" (UID: "b4d26059-df5c-4a0a-9fca-0e4ed50df470"). InnerVolumeSpecName "kube-api-access-k7cds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:58:07.403419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403381    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403409    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-oauth-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403424    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-oauth-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403436    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7cds\" (UniqueName: \"kubernetes.io/projected/b4d26059-df5c-4a0a-9fca-0e4ed50df470-kube-api-access-k7cds\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403445    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-console-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403454    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-service-ca\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.403607 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.403461    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d26059-df5c-4a0a-9fca-0e4ed50df470-trusted-ca-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:07.628160 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.628127    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8tfgc"]
May 28 20:58:07.628484 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.628470    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" containerName="console"
May 28 20:58:07.628528 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.628487    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" containerName="console"
May 28 20:58:07.628574 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.628564    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" containerName="console"
May 28 20:58:07.632930 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.632909    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.635338 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.635323    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 20:58:07.638260 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.638219    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8tfgc"]
May 28 20:58:07.706874 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.706845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-kubelet-config\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.706874 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.706875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-dbus\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.707026 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.706899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3efa99c-a4e0-4eee-9413-27ab5e34f301-original-pull-secret\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.808307 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.808278    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-kubelet-config\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.808307 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.808306    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-dbus\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.808482 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.808325    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3efa99c-a4e0-4eee-9413-27ab5e34f301-original-pull-secret\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.808482 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.808420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-kubelet-config\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.808556 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.808478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3efa99c-a4e0-4eee-9413-27ab5e34f301-dbus\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.810657 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.810640    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3efa99c-a4e0-4eee-9413-27ab5e34f301-original-pull-secret\") pod \"global-pull-secret-syncer-8tfgc\" (UID: \"c3efa99c-a4e0-4eee-9413-27ab5e34f301\") " pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.943508 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.943447    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tfgc"
May 28 20:58:07.991892 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.991869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85f9c89f86-wp72r_b4d26059-df5c-4a0a-9fca-0e4ed50df470/console/0.log"
May 28 20:58:07.992035 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.991911    2562 generic.go:358] "Generic (PLEG): container finished" podID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" containerID="238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817" exitCode=2
May 28 20:58:07.992035 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.991990    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c89f86-wp72r"
May 28 20:58:07.992150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.992034    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c89f86-wp72r" event={"ID":"b4d26059-df5c-4a0a-9fca-0e4ed50df470","Type":"ContainerDied","Data":"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"}
May 28 20:58:07.992150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.992063    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c89f86-wp72r" event={"ID":"b4d26059-df5c-4a0a-9fca-0e4ed50df470","Type":"ContainerDied","Data":"98fb097f973cdb4f118d4e31908884443c857824463cc99c3a9fe88329195969"}
May 28 20:58:07.992150 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:07.992084    2562 scope.go:117] "RemoveContainer" containerID="238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"
May 28 20:58:08.003137 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.002850    2562 scope.go:117] "RemoveContainer" containerID="238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"
May 28 20:58:08.004057 ip-10-0-133-41 kubenswrapper[2562]: E0528 20:58:08.003985    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817\": container with ID starting with 238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817 not found: ID does not exist" containerID="238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"
May 28 20:58:08.004057 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.004022    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817"} err="failed to get container status \"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817\": rpc error: code = NotFound desc = could not find container \"238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817\": container with ID starting with 238638e15c2609e0a99f7b0668dc9cfc4ee58f27f308a5a309f627040495b817 not found: ID does not exist"
May 28 20:58:08.027399 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.027356    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:58:08.032469 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.032440    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f9c89f86-wp72r"]
May 28 20:58:08.073514 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.073477    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8tfgc"]
May 28 20:58:08.076165 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:58:08.076141    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3efa99c_a4e0_4eee_9413_27ab5e34f301.slice/crio-478c5038b99e1d0cdf9611faf836eba93d3ece61560d45323d59d9e0a925a6c0 WatchSource:0}: Error finding container 478c5038b99e1d0cdf9611faf836eba93d3ece61560d45323d59d9e0a925a6c0: Status 404 returned error can't find the container with id 478c5038b99e1d0cdf9611faf836eba93d3ece61560d45323d59d9e0a925a6c0
May 28 20:58:08.077843 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.077826    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:58:08.916054 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.916022    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d26059-df5c-4a0a-9fca-0e4ed50df470" path="/var/lib/kubelet/pods/b4d26059-df5c-4a0a-9fca-0e4ed50df470/volumes"
May 28 20:58:08.996037 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:08.996006    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8tfgc" event={"ID":"c3efa99c-a4e0-4eee-9413-27ab5e34f301","Type":"ContainerStarted","Data":"478c5038b99e1d0cdf9611faf836eba93d3ece61560d45323d59d9e0a925a6c0"}
May 28 20:58:13.008989 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:13.008955    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8tfgc" event={"ID":"c3efa99c-a4e0-4eee-9413-27ab5e34f301","Type":"ContainerStarted","Data":"dd03452e596eee61255fe2e4927d14e13643f2b9c6406da2882c83653bebffdd"}
May 28 20:58:13.024562 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:13.024506    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8tfgc" podStartSLOduration=2.162734 podStartE2EDuration="6.024491128s" podCreationTimestamp="2026-05-28 20:58:07 +0000 UTC" firstStartedPulling="2026-05-28 20:58:08.077980973 +0000 UTC m=+333.755684371" lastFinishedPulling="2026-05-28 20:58:11.939738096 +0000 UTC m=+337.617441499" observedRunningTime="2026-05-28 20:58:13.024162887 +0000 UTC m=+338.701866308" watchObservedRunningTime="2026-05-28 20:58:13.024491128 +0000 UTC m=+338.702194552"
May 28 20:58:39.451055 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.451020    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"]
May 28 20:58:39.454332 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.454315    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.457122 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.457097    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 20:58:39.457253 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.457097    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 20:58:39.457253 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.457163    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 20:58:39.464249 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.464229    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"]
May 28 20:58:39.544293 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.544267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.544397 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.544307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.544397 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.544333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj999\" (UniqueName: \"kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.645688 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.645659    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.645816 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.645700    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.645816 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.645719    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sj999\" (UniqueName: \"kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.646125 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.646105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.646162 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.646118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.655500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.655479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj999\" (UniqueName: \"kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.762798 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.762715    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:39.892549 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:39.892524    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"]
May 28 20:58:39.895933 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:58:39.895475    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5964deb1_952f_4db8_ad41_bfb231274530.slice/crio-48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c WatchSource:0}: Error finding container 48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c: Status 404 returned error can't find the container with id 48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c
May 28 20:58:40.087614 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:40.087537    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql" event={"ID":"5964deb1-952f-4db8-ad41-bfb231274530","Type":"ContainerStarted","Data":"48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c"}
May 28 20:58:46.108128 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:46.108093    2562 generic.go:358] "Generic (PLEG): container finished" podID="5964deb1-952f-4db8-ad41-bfb231274530" containerID="d106e7e198d9f007a8870e55c4f143ff75c4130089e3cc8e0de5b94ff416cd88" exitCode=0
May 28 20:58:46.108519 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:46.108167    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql" event={"ID":"5964deb1-952f-4db8-ad41-bfb231274530","Type":"ContainerDied","Data":"d106e7e198d9f007a8870e55c4f143ff75c4130089e3cc8e0de5b94ff416cd88"}
May 28 20:58:49.119867 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:49.119827    2562 generic.go:358] "Generic (PLEG): container finished" podID="5964deb1-952f-4db8-ad41-bfb231274530" containerID="a647ba40ab9064c5e0e23c2839640e8a2dacb1c760e4e0c6ea5fe24dac4b24eb" exitCode=0
May 28 20:58:49.120238 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:49.119886    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql" event={"ID":"5964deb1-952f-4db8-ad41-bfb231274530","Type":"ContainerDied","Data":"a647ba40ab9064c5e0e23c2839640e8a2dacb1c760e4e0c6ea5fe24dac4b24eb"}
May 28 20:58:56.142353 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:56.142314    2562 generic.go:358] "Generic (PLEG): container finished" podID="5964deb1-952f-4db8-ad41-bfb231274530" containerID="b4f72a8b0f33f3e22f21b887b49fab88a261ea1a07e3bb5a6950b43b38b1a8a9" exitCode=0
May 28 20:58:56.142744 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:56.142397    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql" event={"ID":"5964deb1-952f-4db8-ad41-bfb231274530","Type":"ContainerDied","Data":"b4f72a8b0f33f3e22f21b887b49fab88a261ea1a07e3bb5a6950b43b38b1a8a9"}
May 28 20:58:57.264063 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.264041    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:58:57.305655 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.305630    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle\") pod \"5964deb1-952f-4db8-ad41-bfb231274530\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") "
May 28 20:58:57.305832 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.305664    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util\") pod \"5964deb1-952f-4db8-ad41-bfb231274530\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") "
May 28 20:58:57.305832 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.305697    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj999\" (UniqueName: \"kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999\") pod \"5964deb1-952f-4db8-ad41-bfb231274530\" (UID: \"5964deb1-952f-4db8-ad41-bfb231274530\") "
May 28 20:58:57.306231 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.306209    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle" (OuterVolumeSpecName: "bundle") pod "5964deb1-952f-4db8-ad41-bfb231274530" (UID: "5964deb1-952f-4db8-ad41-bfb231274530"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:58:57.308002 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.307973    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999" (OuterVolumeSpecName: "kube-api-access-sj999") pod "5964deb1-952f-4db8-ad41-bfb231274530" (UID: "5964deb1-952f-4db8-ad41-bfb231274530"). InnerVolumeSpecName "kube-api-access-sj999". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:58:57.311856 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.311828    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util" (OuterVolumeSpecName: "util") pod "5964deb1-952f-4db8-ad41-bfb231274530" (UID: "5964deb1-952f-4db8-ad41-bfb231274530"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:58:57.406902 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.406842    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:57.406902 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.406867    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5964deb1-952f-4db8-ad41-bfb231274530-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:57.406902 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:57.406876    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj999\" (UniqueName: \"kubernetes.io/projected/5964deb1-952f-4db8-ad41-bfb231274530-kube-api-access-sj999\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:58:58.150214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:58.150175    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql" event={"ID":"5964deb1-952f-4db8-ad41-bfb231274530","Type":"ContainerDied","Data":"48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c"}
May 28 20:58:58.150214 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:58.150214    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48883c1c26eb765fb311afd9ef20ba8ca3a9b41e3d799c94666cb58ca608a57c"
May 28 20:58:58.150415 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:58:58.150223    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9nwql"
May 28 20:59:02.758574 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.758533    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"]
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.758978    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="util"
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.758996    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="util"
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.759009    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="pull"
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.759017    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="pull"
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.759034    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="extract"
May 28 20:59:02.759078 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.759042    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="extract"
May 28 20:59:02.759369 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.759135    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5964deb1-952f-4db8-ad41-bfb231274530" containerName="extract"
May 28 20:59:02.805058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.805015    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"]
May 28 20:59:02.805255 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.805161    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.809033 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.809004    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 20:59:02.809162 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.809043    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5m4nj\""
May 28 20:59:02.809549 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.809532    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 20:59:02.848972 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.848944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44q7w\" (UniqueName: \"kubernetes.io/projected/14256471-eb31-4c93-a351-022e93699f24-kube-api-access-44q7w\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.849084 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.848991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14256471-eb31-4c93-a351-022e93699f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.950306 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.950271    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44q7w\" (UniqueName: \"kubernetes.io/projected/14256471-eb31-4c93-a351-022e93699f24-kube-api-access-44q7w\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.950484 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.950330    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14256471-eb31-4c93-a351-022e93699f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.950704 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.950683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14256471-eb31-4c93-a351-022e93699f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:02.961497 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:02.961467    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44q7w\" (UniqueName: \"kubernetes.io/projected/14256471-eb31-4c93-a351-022e93699f24-kube-api-access-44q7w\") pod \"cert-manager-operator-controller-manager-54b9655956-4l7wl\" (UID: \"14256471-eb31-4c93-a351-022e93699f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:03.114439 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:03.114414    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"
May 28 20:59:03.254573 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:03.254549    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl"]
May 28 20:59:03.256632 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:03.256603    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14256471_eb31_4c93_a351_022e93699f24.slice/crio-c328ccf26bb82b72c5bad6ef4608de1be466e5c855f502f6711a687b88c23149 WatchSource:0}: Error finding container c328ccf26bb82b72c5bad6ef4608de1be466e5c855f502f6711a687b88c23149: Status 404 returned error can't find the container with id c328ccf26bb82b72c5bad6ef4608de1be466e5c855f502f6711a687b88c23149
May 28 20:59:04.172007 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:04.171966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl" event={"ID":"14256471-eb31-4c93-a351-022e93699f24","Type":"ContainerStarted","Data":"c328ccf26bb82b72c5bad6ef4608de1be466e5c855f502f6711a687b88c23149"}
May 28 20:59:06.180896 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:06.180861    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl" event={"ID":"14256471-eb31-4c93-a351-022e93699f24","Type":"ContainerStarted","Data":"7c5070f81431b8f8544848db87b0b81481d138ebf1ad4f5101f31f1f27df081d"}
May 28 20:59:06.202997 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:06.202949    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4l7wl" podStartSLOduration=2.16355566 podStartE2EDuration="4.2029307s" podCreationTimestamp="2026-05-28 20:59:02 +0000 UTC" firstStartedPulling="2026-05-28 20:59:03.259065911 +0000 UTC m=+388.936769316" lastFinishedPulling="2026-05-28 20:59:05.298440954 +0000 UTC m=+390.976144356" observedRunningTime="2026-05-28 20:59:06.201713637 +0000 UTC m=+391.879417059" watchObservedRunningTime="2026-05-28 20:59:06.2029307 +0000 UTC m=+391.880634122"
May 28 20:59:07.196849 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.196811    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"]
May 28 20:59:07.219042 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.219019    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"]
May 28 20:59:07.219193 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.219127    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.222054 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.222030    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 20:59:07.223199 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.223181    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 20:59:07.223199 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.223191    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 20:59:07.284346 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.284321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvfj\" (UniqueName: \"kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.284451 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.284354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.284498 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.284464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.385211 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.385176    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.385329 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.385239    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvfj\" (UniqueName: \"kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.385329 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.385263    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.385540 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.385522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.385634 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.385614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.393826 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.393803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvfj\" (UniqueName: \"kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.530127 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.530051    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:07.665458 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:07.665429    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"]
May 28 20:59:08.193103 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.193065    2562 generic.go:358] "Generic (PLEG): container finished" podID="6d534f72-73d3-46f0-a279-e4045caa9067" containerID="69f23c91a36c101bb1ac806d416f39d1dcac6204a4cef8fdfc88aaec56dbbeea" exitCode=0
May 28 20:59:08.193297 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.193162    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm" event={"ID":"6d534f72-73d3-46f0-a279-e4045caa9067","Type":"ContainerDied","Data":"69f23c91a36c101bb1ac806d416f39d1dcac6204a4cef8fdfc88aaec56dbbeea"}
May 28 20:59:08.193297 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.193206    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm" event={"ID":"6d534f72-73d3-46f0-a279-e4045caa9067","Type":"ContainerStarted","Data":"57943bb866c22f927b840ef77790975bef57474bc1411754df2cd5c2919c8e0a"}
May 28 20:59:08.661160 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.661132    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s7c85"]
May 28 20:59:08.681559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.681464    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s7c85"]
May 28 20:59:08.681702 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.681575    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.684153 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.684129    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 20:59:08.684277 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.684129    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6d4cm\""
May 28 20:59:08.684345 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.684330    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 20:59:08.697419 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.697391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.697551 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.697528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqlg\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-kube-api-access-mtqlg\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.798921 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.798896    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.799025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.798954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqlg\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-kube-api-access-mtqlg\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.807099 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.807065    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:08.807481 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:08.807458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqlg\" (UniqueName: \"kubernetes.io/projected/bfb3f99f-6010-4a25-b692-360881b5d225-kube-api-access-mtqlg\") pod \"cert-manager-webhook-587ccfb98-s7c85\" (UID: \"bfb3f99f-6010-4a25-b692-360881b5d225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:09.008466 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:09.008396    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:09.137714 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:09.137677    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s7c85"]
May 28 20:59:09.140404 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:09.140382    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb3f99f_6010_4a25_b692_360881b5d225.slice/crio-2088b92003e5a26d08b62154319e06e46de2e3d64423dd3d5c31eb46a28e6dc2 WatchSource:0}: Error finding container 2088b92003e5a26d08b62154319e06e46de2e3d64423dd3d5c31eb46a28e6dc2: Status 404 returned error can't find the container with id 2088b92003e5a26d08b62154319e06e46de2e3d64423dd3d5c31eb46a28e6dc2
May 28 20:59:09.198247 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:09.198204    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85" event={"ID":"bfb3f99f-6010-4a25-b692-360881b5d225","Type":"ContainerStarted","Data":"2088b92003e5a26d08b62154319e06e46de2e3d64423dd3d5c31eb46a28e6dc2"}
May 28 20:59:13.216692 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:13.216652    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85" event={"ID":"bfb3f99f-6010-4a25-b692-360881b5d225","Type":"ContainerStarted","Data":"1bdc62023043a219cca7cf95d0f3ecc2d4069892fab4287902650d0a7ba1a59b"}
May 28 20:59:13.217116 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:13.216743    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:13.218233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:13.218209    2562 generic.go:358] "Generic (PLEG): container finished" podID="6d534f72-73d3-46f0-a279-e4045caa9067" containerID="cff9f352594d6cd84fc75fbd40b6544b6d01657d8c44205ced85af0a4e9fb7b2" exitCode=0
May 28 20:59:13.218371 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:13.218235    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm" event={"ID":"6d534f72-73d3-46f0-a279-e4045caa9067","Type":"ContainerDied","Data":"cff9f352594d6cd84fc75fbd40b6544b6d01657d8c44205ced85af0a4e9fb7b2"}
May 28 20:59:13.237634 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:13.237591    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85" podStartSLOduration=2.045726755 podStartE2EDuration="5.23757981s" podCreationTimestamp="2026-05-28 20:59:08 +0000 UTC" firstStartedPulling="2026-05-28 20:59:09.142148031 +0000 UTC m=+394.819851429" lastFinishedPulling="2026-05-28 20:59:12.334001072 +0000 UTC m=+398.011704484" observedRunningTime="2026-05-28 20:59:13.235868226 +0000 UTC m=+398.913571647" watchObservedRunningTime="2026-05-28 20:59:13.23757981 +0000 UTC m=+398.915283231"
May 28 20:59:14.224058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:14.224021    2562 generic.go:358] "Generic (PLEG): container finished" podID="6d534f72-73d3-46f0-a279-e4045caa9067" containerID="00a3b846a01fdb05577f51437045bdb99552d5b0c95eeac06f3d8a253cd8f388" exitCode=0
May 28 20:59:14.224461 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:14.224109    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm" event={"ID":"6d534f72-73d3-46f0-a279-e4045caa9067","Type":"ContainerDied","Data":"00a3b846a01fdb05577f51437045bdb99552d5b0c95eeac06f3d8a253cd8f388"}
May 28 20:59:15.350631 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.350609    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:15.453024 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.452993    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nvfj\" (UniqueName: \"kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj\") pod \"6d534f72-73d3-46f0-a279-e4045caa9067\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") "
May 28 20:59:15.453164 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.453050    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util\") pod \"6d534f72-73d3-46f0-a279-e4045caa9067\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") "
May 28 20:59:15.453164 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.453079    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle\") pod \"6d534f72-73d3-46f0-a279-e4045caa9067\" (UID: \"6d534f72-73d3-46f0-a279-e4045caa9067\") "
May 28 20:59:15.453511 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.453486    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle" (OuterVolumeSpecName: "bundle") pod "6d534f72-73d3-46f0-a279-e4045caa9067" (UID: "6d534f72-73d3-46f0-a279-e4045caa9067"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:15.455217 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.455197    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj" (OuterVolumeSpecName: "kube-api-access-9nvfj") pod "6d534f72-73d3-46f0-a279-e4045caa9067" (UID: "6d534f72-73d3-46f0-a279-e4045caa9067"). InnerVolumeSpecName "kube-api-access-9nvfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:59:15.457250 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.457210    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util" (OuterVolumeSpecName: "util") pod "6d534f72-73d3-46f0-a279-e4045caa9067" (UID: "6d534f72-73d3-46f0-a279-e4045caa9067"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:15.553776 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.553690    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nvfj\" (UniqueName: \"kubernetes.io/projected/6d534f72-73d3-46f0-a279-e4045caa9067-kube-api-access-9nvfj\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:15.553776 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.553713    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:15.553776 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:15.553728    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d534f72-73d3-46f0-a279-e4045caa9067-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:16.232328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:16.232302    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm"
May 28 20:59:16.232328 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:16.232318    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb99fm" event={"ID":"6d534f72-73d3-46f0-a279-e4045caa9067","Type":"ContainerDied","Data":"57943bb866c22f927b840ef77790975bef57474bc1411754df2cd5c2919c8e0a"}
May 28 20:59:16.232522 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:16.232351    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57943bb866c22f927b840ef77790975bef57474bc1411754df2cd5c2919c8e0a"
May 28 20:59:18.741359 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741318    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5kj4l"]
May 28 20:59:18.741857 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741801    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="extract"
May 28 20:59:18.741857 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741820    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="extract"
May 28 20:59:18.741857 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741832    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="pull"
May 28 20:59:18.741857 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741841    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="pull"
May 28 20:59:18.742058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741866    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="util"
May 28 20:59:18.742058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741874    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="util"
May 28 20:59:18.742058 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.741959    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d534f72-73d3-46f0-a279-e4045caa9067" containerName="extract"
May 28 20:59:18.746541 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.746518    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.749380 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.749359    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4cskz\""
May 28 20:59:18.754174 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.754154    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5kj4l"]
May 28 20:59:18.780063 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.780036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-bound-sa-token\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.780164 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.780080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cm4g\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-kube-api-access-8cm4g\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.880938 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.880904    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-bound-sa-token\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.881096 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.880947    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cm4g\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-kube-api-access-8cm4g\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.889975 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.889954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-bound-sa-token\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:18.890062 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:18.890028    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cm4g\" (UniqueName: \"kubernetes.io/projected/23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2-kube-api-access-8cm4g\") pod \"cert-manager-79c8d999ff-5kj4l\" (UID: \"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2\") " pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:19.056093 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:19.056003    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5kj4l"
May 28 20:59:19.182679 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:19.182647    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5kj4l"]
May 28 20:59:19.186044 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:19.186013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23e767c8_f04b_4d7a_81d0_0cd5cc3a10c2.slice/crio-9b4433631388775487a968538906528e4fe53b5a46c5f6afb8e55656cd689b30 WatchSource:0}: Error finding container 9b4433631388775487a968538906528e4fe53b5a46c5f6afb8e55656cd689b30: Status 404 returned error can't find the container with id 9b4433631388775487a968538906528e4fe53b5a46c5f6afb8e55656cd689b30
May 28 20:59:19.226258 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:19.226235    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-s7c85"
May 28 20:59:19.243605 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:19.243584    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5kj4l" event={"ID":"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2","Type":"ContainerStarted","Data":"9b4433631388775487a968538906528e4fe53b5a46c5f6afb8e55656cd689b30"}
May 28 20:59:20.247915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:20.247880    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5kj4l" event={"ID":"23e767c8-f04b-4d7a-81d0-0cd5cc3a10c2","Type":"ContainerStarted","Data":"ebcce51bbd5ec2c84ad5eae9fbdc9dec3aacbb3dd66f5f2d5ded93dd0d9452c9"}
May 28 20:59:27.189025 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.188973    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5kj4l" podStartSLOduration=9.188957142 podStartE2EDuration="9.188957142s" podCreationTimestamp="2026-05-28 20:59:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:59:20.263544492 +0000 UTC m=+405.941247914" watchObservedRunningTime="2026-05-28 20:59:27.188957142 +0000 UTC m=+412.866660554"
May 28 20:59:27.189481 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.189237    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"]
May 28 20:59:27.192777 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.192739    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.195504 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.195482    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 20:59:27.195735 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.195721    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 20:59:27.195803 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.195728    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 20:59:27.199916 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.199894    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"]
May 28 20:59:27.248595 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.248567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.248696 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.248609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.248737 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.248695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbgzq\" (UniqueName: \"kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.349878 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.349846    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgzq\" (UniqueName: \"kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.350019 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.349903    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.350019 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.349944    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.350329 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.350312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.350373 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.350352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.358197 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.358167    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgzq\" (UniqueName: \"kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.502834 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.502743    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:27.629611 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:27.629581    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"]
May 28 20:59:28.275620 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:28.275579    2562 generic.go:358] "Generic (PLEG): container finished" podID="d80017f5-f655-4be8-82bb-20e55363885a" containerID="c6f915de3fc8af72527ce69a9ed40c6c7ae813ccb0348763e9ec42e28a5260a3" exitCode=0
May 28 20:59:28.276028 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:28.275668    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw" event={"ID":"d80017f5-f655-4be8-82bb-20e55363885a","Type":"ContainerDied","Data":"c6f915de3fc8af72527ce69a9ed40c6c7ae813ccb0348763e9ec42e28a5260a3"}
May 28 20:59:28.276028 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:28.275700    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw" event={"ID":"d80017f5-f655-4be8-82bb-20e55363885a","Type":"ContainerStarted","Data":"1a2aeac59044ba33c2c9e58f3f2a10eec87e35ec859bdde81857249b6ff142e2"}
May 28 20:59:29.281450 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:29.281415    2562 generic.go:358] "Generic (PLEG): container finished" podID="d80017f5-f655-4be8-82bb-20e55363885a" containerID="353775433fdf840bbc25f61e624244a8e645f98db953095e4f0c325e0db7ede7" exitCode=0
May 28 20:59:29.281861 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:29.281457    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw" event={"ID":"d80017f5-f655-4be8-82bb-20e55363885a","Type":"ContainerDied","Data":"353775433fdf840bbc25f61e624244a8e645f98db953095e4f0c325e0db7ede7"}
May 28 20:59:30.287076 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:30.287035    2562 generic.go:358] "Generic (PLEG): container finished" podID="d80017f5-f655-4be8-82bb-20e55363885a" containerID="2f62694b4ff05ee7099f66b126029f33b193a80ecea049372898b9945be823c4" exitCode=0
May 28 20:59:30.287447 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:30.287123    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw" event={"ID":"d80017f5-f655-4be8-82bb-20e55363885a","Type":"ContainerDied","Data":"2f62694b4ff05ee7099f66b126029f33b193a80ecea049372898b9945be823c4"}
May 28 20:59:31.424684 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.424661    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:31.484566 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.484538    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util\") pod \"d80017f5-f655-4be8-82bb-20e55363885a\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") "
May 28 20:59:31.484709 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.484572    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbgzq\" (UniqueName: \"kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq\") pod \"d80017f5-f655-4be8-82bb-20e55363885a\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") "
May 28 20:59:31.484709 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.484611    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle\") pod \"d80017f5-f655-4be8-82bb-20e55363885a\" (UID: \"d80017f5-f655-4be8-82bb-20e55363885a\") "
May 28 20:59:31.485414 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.485389    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle" (OuterVolumeSpecName: "bundle") pod "d80017f5-f655-4be8-82bb-20e55363885a" (UID: "d80017f5-f655-4be8-82bb-20e55363885a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:31.486858 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.486826    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq" (OuterVolumeSpecName: "kube-api-access-lbgzq") pod "d80017f5-f655-4be8-82bb-20e55363885a" (UID: "d80017f5-f655-4be8-82bb-20e55363885a"). InnerVolumeSpecName "kube-api-access-lbgzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:59:31.489946 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.489918    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util" (OuterVolumeSpecName: "util") pod "d80017f5-f655-4be8-82bb-20e55363885a" (UID: "d80017f5-f655-4be8-82bb-20e55363885a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:31.585875 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.585797    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:31.585875 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.585835    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbgzq\" (UniqueName: \"kubernetes.io/projected/d80017f5-f655-4be8-82bb-20e55363885a-kube-api-access-lbgzq\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:31.585875 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:31.585849    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80017f5-f655-4be8-82bb-20e55363885a-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:32.295236 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:32.295209    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw"
May 28 20:59:32.295236 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:32.295220    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lqvtw" event={"ID":"d80017f5-f655-4be8-82bb-20e55363885a","Type":"ContainerDied","Data":"1a2aeac59044ba33c2c9e58f3f2a10eec87e35ec859bdde81857249b6ff142e2"}
May 28 20:59:32.295438 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:32.295248    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a2aeac59044ba33c2c9e58f3f2a10eec87e35ec859bdde81857249b6ff142e2"
May 28 20:59:44.157739 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.157698    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"]
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158170    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="util"
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158188    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="util"
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158208    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="pull"
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158216    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="pull"
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158226    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="extract"
May 28 20:59:44.158233 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158235    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="extract"
May 28 20:59:44.158581 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.158348    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d80017f5-f655-4be8-82bb-20e55363885a" containerName="extract"
May 28 20:59:44.163660 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.163638    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.167205 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.167183    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 20:59:44.167205 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.167203    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 20:59:44.167371 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.167220    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 20:59:44.167371 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.167271    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s2tr4\""
May 28 20:59:44.167515 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.167503    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 20:59:44.172526 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.172500    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"]
May 28 20:59:44.291603 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.291575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j89t2\" (UniqueName: \"kubernetes.io/projected/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-kube-api-access-j89t2\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.291742 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.291612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.291742 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.291683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.392877 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.392841    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j89t2\" (UniqueName: \"kubernetes.io/projected/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-kube-api-access-j89t2\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.393017 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.392896    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.393017 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.392953    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.395515 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.395491    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.395515 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.395506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.408071 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.408003    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"]
May 28 20:59:44.414288 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.414266    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.416018 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.415992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89t2\" (UniqueName: \"kubernetes.io/projected/71a2fbbc-9b23-4cb7-a0bf-861784f94bce-kube-api-access-j89t2\") pod \"opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5\" (UID: \"71a2fbbc-9b23-4cb7-a0bf-861784f94bce\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.418195 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.418170    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 20:59:44.418195 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.418186    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 20:59:44.419338 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.419312    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 20:59:44.420862 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.420845    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"]
May 28 20:59:44.474626 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.474602    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:44.594499 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.594470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnk6k\" (UniqueName: \"kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.594646 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.594512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.594646 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.594558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.695031 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.694950    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnk6k\" (UniqueName: \"kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.695031 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.694990    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.695031 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.695014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.695369 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.695352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.695417 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.695374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.703339 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.703315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnk6k\" (UniqueName: \"kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.732304 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.732284    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:44.874690 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.874663    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"]
May 28 20:59:44.888626 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:44.888600    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a2fbbc_9b23_4cb7_a0bf_861784f94bce.slice/crio-56769d1defd23626e6e37bae5622e7101334f5990e8172372de6bb15f36c74c8 WatchSource:0}: Error finding container 56769d1defd23626e6e37bae5622e7101334f5990e8172372de6bb15f36c74c8: Status 404 returned error can't find the container with id 56769d1defd23626e6e37bae5622e7101334f5990e8172372de6bb15f36c74c8
May 28 20:59:44.892815 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:44.892789    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"]
May 28 20:59:44.899305 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:44.899283    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89e2871_584e_478c_a160_7326745b7d78.slice/crio-4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844 WatchSource:0}: Error finding container 4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844: Status 404 returned error can't find the container with id 4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844
May 28 20:59:45.344582 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:45.344435    2562 generic.go:358] "Generic (PLEG): container finished" podID="c89e2871-584e-478c-a160-7326745b7d78" containerID="8820bb864993030828d5dda76389733cf8e613f5b91fb82843243e826b7637c9" exitCode=0
May 28 20:59:45.344582 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:45.344519    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7" event={"ID":"c89e2871-584e-478c-a160-7326745b7d78","Type":"ContainerDied","Data":"8820bb864993030828d5dda76389733cf8e613f5b91fb82843243e826b7637c9"}
May 28 20:59:45.344582 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:45.344546    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7" event={"ID":"c89e2871-584e-478c-a160-7326745b7d78","Type":"ContainerStarted","Data":"4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844"}
May 28 20:59:45.346219 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:45.346160    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5" event={"ID":"71a2fbbc-9b23-4cb7-a0bf-861784f94bce","Type":"ContainerStarted","Data":"56769d1defd23626e6e37bae5622e7101334f5990e8172372de6bb15f36c74c8"}
May 28 20:59:48.359237 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:48.359200    2562 generic.go:358] "Generic (PLEG): container finished" podID="c89e2871-584e-478c-a160-7326745b7d78" containerID="6ac8475fd53d86640207a19497dcede3e8d8f3b848483c75bb30f3d0dcd4ff59" exitCode=0
May 28 20:59:48.359814 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:48.359280    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7" event={"ID":"c89e2871-584e-478c-a160-7326745b7d78","Type":"ContainerDied","Data":"6ac8475fd53d86640207a19497dcede3e8d8f3b848483c75bb30f3d0dcd4ff59"}
May 28 20:59:48.360918 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:48.360866    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5" event={"ID":"71a2fbbc-9b23-4cb7-a0bf-861784f94bce","Type":"ContainerStarted","Data":"7dd2096cf9b9934fb8d26fe443353283f99aa1b27f9bfa712c340c455d7f54bd"}
May 28 20:59:48.361011 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:48.360951    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 20:59:48.430809 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:48.430765    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5" podStartSLOduration=1.929942768 podStartE2EDuration="4.430737313s" podCreationTimestamp="2026-05-28 20:59:44 +0000 UTC" firstStartedPulling="2026-05-28 20:59:44.890601814 +0000 UTC m=+430.568305216" lastFinishedPulling="2026-05-28 20:59:47.391396359 +0000 UTC m=+433.069099761" observedRunningTime="2026-05-28 20:59:48.428276319 +0000 UTC m=+434.105979746" watchObservedRunningTime="2026-05-28 20:59:48.430737313 +0000 UTC m=+434.108440733"
May 28 20:59:49.368056 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:49.368026    2562 generic.go:358] "Generic (PLEG): container finished" podID="c89e2871-584e-478c-a160-7326745b7d78" containerID="61a4fb4d8084446e12077ffa8029654ef45ec22feaa61ecd52337f578c33bf17" exitCode=0
May 28 20:59:49.368430 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:49.368115    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7" event={"ID":"c89e2871-584e-478c-a160-7326745b7d78","Type":"ContainerDied","Data":"61a4fb4d8084446e12077ffa8029654ef45ec22feaa61ecd52337f578c33bf17"}
May 28 20:59:50.497463 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.497441    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:50.646545 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.646471    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle\") pod \"c89e2871-584e-478c-a160-7326745b7d78\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") "
May 28 20:59:50.646545 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.646527    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnk6k\" (UniqueName: \"kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k\") pod \"c89e2871-584e-478c-a160-7326745b7d78\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") "
May 28 20:59:50.646720 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.646571    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util\") pod \"c89e2871-584e-478c-a160-7326745b7d78\" (UID: \"c89e2871-584e-478c-a160-7326745b7d78\") "
May 28 20:59:50.647394 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.647331    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle" (OuterVolumeSpecName: "bundle") pod "c89e2871-584e-478c-a160-7326745b7d78" (UID: "c89e2871-584e-478c-a160-7326745b7d78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:50.648854 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.648828    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k" (OuterVolumeSpecName: "kube-api-access-xnk6k") pod "c89e2871-584e-478c-a160-7326745b7d78" (UID: "c89e2871-584e-478c-a160-7326745b7d78"). InnerVolumeSpecName "kube-api-access-xnk6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:59:50.651546 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.651516    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util" (OuterVolumeSpecName: "util") pod "c89e2871-584e-478c-a160-7326745b7d78" (UID: "c89e2871-584e-478c-a160-7326745b7d78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 20:59:50.748029 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.748003    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnk6k\" (UniqueName: \"kubernetes.io/projected/c89e2871-584e-478c-a160-7326745b7d78-kube-api-access-xnk6k\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:50.748029 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.748026    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:50.748178 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:50.748038    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89e2871-584e-478c-a160-7326745b7d78-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 20:59:51.377154 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:51.377127    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7"
May 28 20:59:51.377154 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:51.377136    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9vk5m7" event={"ID":"c89e2871-584e-478c-a160-7326745b7d78","Type":"ContainerDied","Data":"4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844"}
May 28 20:59:51.377353 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:51.377164    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4154a3f1e64347aff091dd4d027adbb4169456b01e43f719cdacdb23dd168844"
May 28 20:59:54.900915 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.900824    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"]
May 28 20:59:54.901327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901282    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="extract"
May 28 20:59:54.901327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901302    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="extract"
May 28 20:59:54.901327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901314    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="util"
May 28 20:59:54.901327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901319    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="util"
May 28 20:59:54.901327 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901328    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="pull"
May 28 20:59:54.901500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901334    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="pull"
May 28 20:59:54.901500 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.901410    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="c89e2871-584e-478c-a160-7326745b7d78" containerName="extract"
May 28 20:59:54.904473 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.904451    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:54.911390 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911345    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jrrkq\""
May 28 20:59:54.911390 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911375    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 20:59:54.911559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911408    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 20:59:54.911559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911380    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 20:59:54.911559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911484    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 20:59:54.911559 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.911499    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 20:59:54.917469 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:54.917450    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"]
May 28 20:59:55.083468 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.083432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.083468 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.083471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs6qk\" (UniqueName: \"kubernetes.io/projected/86e7519a-e888-4eb2-a1f1-812d69044442-kube-api-access-cs6qk\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.083656 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.083497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-metrics-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.083656 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.083596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86e7519a-e888-4eb2-a1f1-812d69044442-manager-config\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.184707 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.184629    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.184707 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.184666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs6qk\" (UniqueName: \"kubernetes.io/projected/86e7519a-e888-4eb2-a1f1-812d69044442-kube-api-access-cs6qk\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.184707 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.184696    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-metrics-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.184928 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.184781    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86e7519a-e888-4eb2-a1f1-812d69044442-manager-config\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.185379 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.185355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86e7519a-e888-4eb2-a1f1-812d69044442-manager-config\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.187137 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.187116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.187294 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.187273    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86e7519a-e888-4eb2-a1f1-812d69044442-metrics-cert\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.200027 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.200002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs6qk\" (UniqueName: \"kubernetes.io/projected/86e7519a-e888-4eb2-a1f1-812d69044442-kube-api-access-cs6qk\") pod \"lws-controller-manager-8459dbdd59-97qmg\" (UID: \"86e7519a-e888-4eb2-a1f1-812d69044442\") " pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.213876 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.213854    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:55.382611 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:55.382574    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"]
May 28 20:59:55.391932 ip-10-0-133-41 kubenswrapper[2562]: W0528 20:59:55.391893    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e7519a_e888_4eb2_a1f1_812d69044442.slice/crio-e22ae05aa5989309f655fc10b98c0ab294d656471b35647a3aea6f7b81fc181a WatchSource:0}: Error finding container e22ae05aa5989309f655fc10b98c0ab294d656471b35647a3aea6f7b81fc181a: Status 404 returned error can't find the container with id e22ae05aa5989309f655fc10b98c0ab294d656471b35647a3aea6f7b81fc181a
May 28 20:59:56.396571 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:56.396538    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg" event={"ID":"86e7519a-e888-4eb2-a1f1-812d69044442","Type":"ContainerStarted","Data":"e22ae05aa5989309f655fc10b98c0ab294d656471b35647a3aea6f7b81fc181a"}
May 28 20:59:58.410720 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:58.410676    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg" event={"ID":"86e7519a-e888-4eb2-a1f1-812d69044442","Type":"ContainerStarted","Data":"ae4bd6ae411f43b55683bf4620f13a1252289a8c6d7257bd38522ce6d95e5095"}
May 28 20:59:58.410720 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:58.410727    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 20:59:58.428038 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:58.427992    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg" podStartSLOduration=1.8902315 podStartE2EDuration="4.427975954s" podCreationTimestamp="2026-05-28 20:59:54 +0000 UTC" firstStartedPulling="2026-05-28 20:59:55.393778006 +0000 UTC m=+441.071481405" lastFinishedPulling="2026-05-28 20:59:57.931522445 +0000 UTC m=+443.609225859" observedRunningTime="2026-05-28 20:59:58.426773192 +0000 UTC m=+444.104476610" watchObservedRunningTime="2026-05-28 20:59:58.427975954 +0000 UTC m=+444.105679376"
May 28 20:59:59.370392 ip-10-0-133-41 kubenswrapper[2562]: I0528 20:59:59.370362    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5"
May 28 21:00:01.835972 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.835920    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"]
May 28 21:00:01.839707 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.839686    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:01.844005 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.843986    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 21:00:01.844734 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.844711    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 21:00:01.845309 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.845290    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 21:00:01.850208 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.850183    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"]
May 28 21:00:01.937049 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.937016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:01.937232 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.937061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:01.937232 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:01.937186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.038496 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.038456    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.038710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.038523    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.038710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.038569    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.039001 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.038975    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.039001 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.038995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.050596 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.050570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.150131 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.150096    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:02.289412 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.289378    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"]
May 28 21:00:02.296891 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:00:02.296863    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e17f0a_d0fb_4c66_84f1_dbcb03ec8b69.slice/crio-d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd WatchSource:0}: Error finding container d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd: Status 404 returned error can't find the container with id d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd
May 28 21:00:02.425722 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.425682    2562 generic.go:358] "Generic (PLEG): container finished" podID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerID="bd49ea495f006a30a90c921a7fc5dd5e0bf250952be24f87b9e64c642365f722" exitCode=0
May 28 21:00:02.425900 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.425732    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp" event={"ID":"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69","Type":"ContainerDied","Data":"bd49ea495f006a30a90c921a7fc5dd5e0bf250952be24f87b9e64c642365f722"}
May 28 21:00:02.425900 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:02.425788    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp" event={"ID":"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69","Type":"ContainerStarted","Data":"d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd"}
May 28 21:00:09.415864 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:09.415836    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8459dbdd59-97qmg"
May 28 21:00:17.489537 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:17.489505    2562 generic.go:358] "Generic (PLEG): container finished" podID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerID="1912c368194816f338c05979ab39d53897a8f17248f12e21fc1c8224d19e4e17" exitCode=0
May 28 21:00:17.489917 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:17.489602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp" event={"ID":"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69","Type":"ContainerDied","Data":"1912c368194816f338c05979ab39d53897a8f17248f12e21fc1c8224d19e4e17"}
May 28 21:00:18.495201 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:18.495170    2562 generic.go:358] "Generic (PLEG): container finished" podID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerID="656c2c7eb8b58929c12f65b112ee994acc5cf9db7042d4a87fd60f6a87b20aca" exitCode=0
May 28 21:00:18.495581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:18.495259    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp" event={"ID":"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69","Type":"ContainerDied","Data":"656c2c7eb8b58929c12f65b112ee994acc5cf9db7042d4a87fd60f6a87b20aca"}
May 28 21:00:19.622958 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.622932    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:19.693702 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.693663    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util\") pod \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") "
May 28 21:00:19.693911 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.693823    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f\") pod \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") "
May 28 21:00:19.693911 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.693859    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle\") pod \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\" (UID: \"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69\") "
May 28 21:00:19.694902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.694862    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle" (OuterVolumeSpecName: "bundle") pod "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" (UID: "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:00:19.696007 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.695990    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f" (OuterVolumeSpecName: "kube-api-access-xzs2f") pod "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" (UID: "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69"). InnerVolumeSpecName "kube-api-access-xzs2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:00:19.697947 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.697920    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util" (OuterVolumeSpecName: "util") pod "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" (UID: "03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:00:19.794743 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.794671    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzs2f\" (UniqueName: \"kubernetes.io/projected/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-kube-api-access-xzs2f\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:19.794743 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.794699    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:19.794743 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:19.794709    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:20.502569 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:20.502543    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp"
May 28 21:00:20.502569 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:20.502560    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vc6rp" event={"ID":"03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69","Type":"ContainerDied","Data":"d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd"}
May 28 21:00:20.502792 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:20.502593    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9541a05e13f8fb4a214d8a7dd76184ad02b0c27f3fecf97ec33065c8d8589bd"
May 28 21:00:26.133192 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133154    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"]
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133492    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="util"
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133506    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="util"
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133516    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="pull"
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133521    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="pull"
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133538    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="extract"
May 28 21:00:26.133581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133543    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="extract"
May 28 21:00:26.133786 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.133591    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="03e17f0a-d0fb-4c66-84f1-dbcb03ec8b69" containerName="extract"
May 28 21:00:26.135641 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.135624    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.138513 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.138491    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 21:00:26.138594 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.138534    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 21:00:26.139564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.139547    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 21:00:26.152143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.152110    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"]
May 28 21:00:26.246515 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.246475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.246712 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.246546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2dw\" (UniqueName: \"kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.246712 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.246645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.347353 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.347318    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2dw\" (UniqueName: \"kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.347545 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.347369    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.347545 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.347430    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.347888 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.347868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.347939 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.347885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.359646 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.359612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2dw\" (UniqueName: \"kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.444907 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.444819    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:26.582138 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:26.582114    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"]
May 28 21:00:26.584316 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:00:26.584278    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f45e452_fc05_4cf6_96dc_2c85e22e7965.slice/crio-23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296 WatchSource:0}: Error finding container 23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296: Status 404 returned error can't find the container with id 23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296
May 28 21:00:27.528490 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:27.528451    2562 generic.go:358] "Generic (PLEG): container finished" podID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerID="e819b48438521be6ab883b6c449d83fc9a07641d05a4a87e4c4cd2ed78d08369" exitCode=0
May 28 21:00:27.528946 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:27.528504    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerDied","Data":"e819b48438521be6ab883b6c449d83fc9a07641d05a4a87e4c4cd2ed78d08369"}
May 28 21:00:27.528946 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:27.528530    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerStarted","Data":"23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296"}
May 28 21:00:28.536580 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:28.536542    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerStarted","Data":"83f30c1a7dbef7ea11a5a597434bba864f20ffdb53ab5ede9d2964efa0863055"}
May 28 21:00:29.541709 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:29.541666    2562 generic.go:358] "Generic (PLEG): container finished" podID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerID="83f30c1a7dbef7ea11a5a597434bba864f20ffdb53ab5ede9d2964efa0863055" exitCode=0
May 28 21:00:29.542111 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:29.541733    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerDied","Data":"83f30c1a7dbef7ea11a5a597434bba864f20ffdb53ab5ede9d2964efa0863055"}
May 28 21:00:30.546655 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:30.546620    2562 generic.go:358] "Generic (PLEG): container finished" podID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerID="d7c24e560a8299243979468ee4f7040a5e9db6b80f7a5fafe76593fc69033948" exitCode=0
May 28 21:00:30.547055 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:30.546719    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerDied","Data":"d7c24e560a8299243979468ee4f7040a5e9db6b80f7a5fafe76593fc69033948"}
May 28 21:00:31.679170 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.679147    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:31.794330 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.794284    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle\") pod \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") "
May 28 21:00:31.794517 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.794361    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k2dw\" (UniqueName: \"kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw\") pod \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") "
May 28 21:00:31.794517 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.794427    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util\") pod \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\" (UID: \"5f45e452-fc05-4cf6-96dc-2c85e22e7965\") "
May 28 21:00:31.795182 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.795154    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle" (OuterVolumeSpecName: "bundle") pod "5f45e452-fc05-4cf6-96dc-2c85e22e7965" (UID: "5f45e452-fc05-4cf6-96dc-2c85e22e7965"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:00:31.796598 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.796575    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw" (OuterVolumeSpecName: "kube-api-access-4k2dw") pod "5f45e452-fc05-4cf6-96dc-2c85e22e7965" (UID: "5f45e452-fc05-4cf6-96dc-2c85e22e7965"). InnerVolumeSpecName "kube-api-access-4k2dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:00:31.800197 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.800172    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util" (OuterVolumeSpecName: "util") pod "5f45e452-fc05-4cf6-96dc-2c85e22e7965" (UID: "5f45e452-fc05-4cf6-96dc-2c85e22e7965"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:00:31.895204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.895178    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:31.895341 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.895203    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k2dw\" (UniqueName: \"kubernetes.io/projected/5f45e452-fc05-4cf6-96dc-2c85e22e7965-kube-api-access-4k2dw\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:31.895341 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:31.895225    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f45e452-fc05-4cf6-96dc-2c85e22e7965-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:00:32.556330 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:32.556294    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5" event={"ID":"5f45e452-fc05-4cf6-96dc-2c85e22e7965","Type":"ContainerDied","Data":"23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296"}
May 28 21:00:32.556330 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:32.556325    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aklvr5"
May 28 21:00:32.556330 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:32.556332    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23fcc4a2a26e8de4d2565ba6f758d06e32908a0966b6d5554860d01d86d42296"
May 28 21:00:52.797465 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.797423    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:00:52.798227 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798205    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="extract"
May 28 21:00:52.798322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798229    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="extract"
May 28 21:00:52.798322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798270    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="pull"
May 28 21:00:52.798322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798280    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="pull"
May 28 21:00:52.798322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798304    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="util"
May 28 21:00:52.798322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798313    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="util"
May 28 21:00:52.798587 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.798407    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f45e452-fc05-4cf6-96dc-2c85e22e7965" containerName="extract"
May 28 21:00:52.801959 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.801940    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.804787 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.804702    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 21:00:52.804902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.804702    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 21:00:52.804902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.804710    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 21:00:52.805021 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.804904    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xm4dc\""
May 28 21:00:52.813431 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.813409    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:00:52.882193 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jx6\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882633 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882633 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.882633 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.882507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.901799 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.901771    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"]
May 28 21:00:52.905052 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.905034    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.919936 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.919902    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"]
May 28 21:00:52.983566 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983536    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96jx6\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.983718 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.983718 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.983718 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbhc6\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-kube-api-access-kbhc6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.983718 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.983718 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.983963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.983963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.983963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.983963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983898    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.983963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983930    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.983968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984027    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984056    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.984204 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984182    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984506 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:52.984506 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984506 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984857 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984515    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984857 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.984857 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.984539    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.986202 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.986182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:52.986309 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:52.986294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:53.008584 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.008561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jx6\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:53.008667 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.008608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:53.085727 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.085639    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbhc6\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-kube-api-access-kbhc6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.085884 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.085772    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.085884 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.085835    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.085954 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.085916    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.085992 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.085981    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086032 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086008    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086070 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086051    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086116 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086091    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086167 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086114    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086222 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086277 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086363 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086467 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.086730 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.086710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.088321 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.088288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.088528 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.088509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.093362 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.093338    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.093738 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.093720    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbhc6\" (UniqueName: \"kubernetes.io/projected/68c3f9d9-e389-413a-bc82-f71fb6f583cc-kube-api-access-kbhc6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blbx7b\" (UID: \"68c3f9d9-e389-413a-bc82-f71fb6f583cc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.114617 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.114585    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:53.221152 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.221121    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:53.247433 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.247401    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:00:53.248622 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:00:53.248594    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76e5dc6_05ab_4505_9b29_35c14b8f8aed.slice/crio-19182bcdea31221eb06867f847d0405ccd17377cff6ea268b87952632c3234bb WatchSource:0}: Error finding container 19182bcdea31221eb06867f847d0405ccd17377cff6ea268b87952632c3234bb: Status 404 returned error can't find the container with id 19182bcdea31221eb06867f847d0405ccd17377cff6ea268b87952632c3234bb
May 28 21:00:53.351588 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.351565    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"]
May 28 21:00:53.353228 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:00:53.353198    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c3f9d9_e389_413a_bc82_f71fb6f583cc.slice/crio-7d4793a42a1ff6aa783e2027ef6af1ced0c5d3ed59f1f026e16745bf9ee939c5 WatchSource:0}: Error finding container 7d4793a42a1ff6aa783e2027ef6af1ced0c5d3ed59f1f026e16745bf9ee939c5: Status 404 returned error can't find the container with id 7d4793a42a1ff6aa783e2027ef6af1ced0c5d3ed59f1f026e16745bf9ee939c5
May 28 21:00:53.630638 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.630544    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" event={"ID":"a76e5dc6-05ab-4505-9b29-35c14b8f8aed","Type":"ContainerStarted","Data":"19182bcdea31221eb06867f847d0405ccd17377cff6ea268b87952632c3234bb"}
May 28 21:00:53.631594 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:53.631572    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b" event={"ID":"68c3f9d9-e389-413a-bc82-f71fb6f583cc","Type":"ContainerStarted","Data":"7d4793a42a1ff6aa783e2027ef6af1ced0c5d3ed59f1f026e16745bf9ee939c5"}
May 28 21:00:55.916818 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.916301    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:55.916818 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.916391    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:55.916818 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.916433    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:55.928963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.928927    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:55.929056 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.928997    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:55.929056 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:55.929046    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:00:56.645388 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:56.645348    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" event={"ID":"a76e5dc6-05ab-4505-9b29-35c14b8f8aed","Type":"ContainerStarted","Data":"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"}
May 28 21:00:56.646722 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:56.646698    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b" event={"ID":"68c3f9d9-e389-413a-bc82-f71fb6f583cc","Type":"ContainerStarted","Data":"dc97a836f006e07b085231a8225af5e5d5b0bc0bc1ff19f7ed37bf7625e93888"}
May 28 21:00:56.666932 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:56.666889    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" podStartSLOduration=2.001233794 podStartE2EDuration="4.666877646s" podCreationTimestamp="2026-05-28 21:00:52 +0000 UTC" firstStartedPulling="2026-05-28 21:00:53.250350484 +0000 UTC m=+498.928053884" lastFinishedPulling="2026-05-28 21:00:55.915994332 +0000 UTC m=+501.593697736" observedRunningTime="2026-05-28 21:00:56.664386416 +0000 UTC m=+502.342089836" watchObservedRunningTime="2026-05-28 21:00:56.666877646 +0000 UTC m=+502.344581119"
May 28 21:00:56.682678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:56.682640    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b" podStartSLOduration=2.109049555 podStartE2EDuration="4.682631304s" podCreationTimestamp="2026-05-28 21:00:52 +0000 UTC" firstStartedPulling="2026-05-28 21:00:53.355078165 +0000 UTC m=+499.032781564" lastFinishedPulling="2026-05-28 21:00:55.928659915 +0000 UTC m=+501.606363313" observedRunningTime="2026-05-28 21:00:56.681633142 +0000 UTC m=+502.359336561" watchObservedRunningTime="2026-05-28 21:00:56.682631304 +0000 UTC m=+502.360334726"
May 28 21:00:57.115394 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.115361    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:00:57.116678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.116649    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
May 28 21:00:57.116805 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.116710    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
May 28 21:00:57.221368 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.221339    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:57.225602 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.225582    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:57.649590 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.649557    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:57.650534 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.650514    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blbx7b"
May 28 21:00:57.697676 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:57.697648    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:00:58.115069 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:58.115039    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
May 28 21:00:58.115227 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:58.115092    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
May 28 21:00:59.115924 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:59.115896    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
May 28 21:00:59.116304 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:59.115944    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
May 28 21:00:59.656585 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:00:59.656552    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy" containerID="cri-o://eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf" gracePeriod=30
May 28 21:01:02.745578 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.745532    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljcvz"]
May 28 21:01:02.750833 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.750807    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:02.754435 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.754408    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 21:01:02.754581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.754444    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9p6v7\""
May 28 21:01:02.754655 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.754461    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 21:01:02.756910 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.756883    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljcvz"]
May 28 21:01:02.873522 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.873490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr99m\" (UniqueName: \"kubernetes.io/projected/fb398409-5d84-4ca1-bfbd-dbd1240a0284-kube-api-access-qr99m\") pod \"kuadrant-operator-catalog-ljcvz\" (UID: \"fb398409-5d84-4ca1-bfbd-dbd1240a0284\") " pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:02.974671 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.974640    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr99m\" (UniqueName: \"kubernetes.io/projected/fb398409-5d84-4ca1-bfbd-dbd1240a0284-kube-api-access-qr99m\") pod \"kuadrant-operator-catalog-ljcvz\" (UID: \"fb398409-5d84-4ca1-bfbd-dbd1240a0284\") " pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:02.982814 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:02.982788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr99m\" (UniqueName: \"kubernetes.io/projected/fb398409-5d84-4ca1-bfbd-dbd1240a0284-kube-api-access-qr99m\") pod \"kuadrant-operator-catalog-ljcvz\" (UID: \"fb398409-5d84-4ca1-bfbd-dbd1240a0284\") " pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:03.062588 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:03.062521    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:03.191883 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:03.191859    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljcvz"]
May 28 21:01:03.194040 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:03.194013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb398409_5d84_4ca1_bfbd_dbd1240a0284.slice/crio-a1cf75fbaa4e1769eb4531e2d5666621d0b68e3ca4f79071ecc5c9084258969a WatchSource:0}: Error finding container a1cf75fbaa4e1769eb4531e2d5666621d0b68e3ca4f79071ecc5c9084258969a: Status 404 returned error can't find the container with id a1cf75fbaa4e1769eb4531e2d5666621d0b68e3ca4f79071ecc5c9084258969a
May 28 21:01:03.672390 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:03.672352    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz" event={"ID":"fb398409-5d84-4ca1-bfbd-dbd1240a0284","Type":"ContainerStarted","Data":"a1cf75fbaa4e1769eb4531e2d5666621d0b68e3ca4f79071ecc5c9084258969a"}
May 28 21:01:04.915523 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.915459    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:01:04.995976 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.995946    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996104 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.995984    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996104 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996031    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996103    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996138    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996175    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96jx6\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996201    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996223    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996267 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996235    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:04.996564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996276    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket\") pod \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\" (UID: \"a76e5dc6-05ab-4505-9b29-35c14b8f8aed\") "
May 28 21:01:04.996564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996411    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:04.996564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996486    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:01:04.996710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996576    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data" (OuterVolumeSpecName: "istio-data") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:04.996710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996675    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-certs\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:04.996710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996694    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istiod-ca-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:04.996710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996702    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-workload-socket\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:04.996710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996702    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:04.997167 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.996711    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-data\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:04.998471 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.998441    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
May 28 21:01:04.998574 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.998491    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:04.998574 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.998504    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6" (OuterVolumeSpecName: "kube-api-access-96jx6") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "kube-api-access-96jx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:04.998645 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:04.998581    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token" (OuterVolumeSpecName: "istio-token") pod "a76e5dc6-05ab-4505-9b29-35c14b8f8aed" (UID: "a76e5dc6-05ab-4505-9b29-35c14b8f8aed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:05.097294 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.097269    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96jx6\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-kube-api-access-96jx6\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:05.097294 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.097294    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-token\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:05.097439 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.097306    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-credential-socket\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:05.097439 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.097316    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-podinfo\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:05.097439 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.097325    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a76e5dc6-05ab-4505-9b29-35c14b8f8aed-istio-envoy\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:05.683984 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.683934    2562 generic.go:358] "Generic (PLEG): container finished" podID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerID="eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf" exitCode=0
May 28 21:01:05.684295 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.684005    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"
May 28 21:01:05.684295 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.684018    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" event={"ID":"a76e5dc6-05ab-4505-9b29-35c14b8f8aed","Type":"ContainerDied","Data":"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"}
May 28 21:01:05.684295 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.684063    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv" event={"ID":"a76e5dc6-05ab-4505-9b29-35c14b8f8aed","Type":"ContainerDied","Data":"19182bcdea31221eb06867f847d0405ccd17377cff6ea268b87952632c3234bb"}
May 28 21:01:05.684295 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.684084    2562 scope.go:117] "RemoveContainer" containerID="eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"
May 28 21:01:05.693945 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.693910    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz" event={"ID":"fb398409-5d84-4ca1-bfbd-dbd1240a0284","Type":"ContainerStarted","Data":"cc147b03b93e128fe8bb6a046b9c25c3ef1cdc486d99a1a1fab0484baf92ada2"}
May 28 21:01:05.701701 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.701683    2562 scope.go:117] "RemoveContainer" containerID="eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"
May 28 21:01:05.701990 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:01:05.701969    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf\": container with ID starting with eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf not found: ID does not exist" containerID="eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"
May 28 21:01:05.702087 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.701997    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf"} err="failed to get container status \"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf\": rpc error: code = NotFound desc = could not find container \"eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf\": container with ID starting with eaba34d3c5f39ea828b21eac52b09a442b6cdf8767425a94d0e3a45ef41376bf not found: ID does not exist"
May 28 21:01:05.711333 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.711293    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz" podStartSLOduration=1.333604082 podStartE2EDuration="3.711280863s" podCreationTimestamp="2026-05-28 21:01:02 +0000 UTC" firstStartedPulling="2026-05-28 21:01:03.195383666 +0000 UTC m=+508.873087066" lastFinishedPulling="2026-05-28 21:01:05.573060445 +0000 UTC m=+511.250763847" observedRunningTime="2026-05-28 21:01:05.709007116 +0000 UTC m=+511.386710550" watchObservedRunningTime="2026-05-28 21:01:05.711280863 +0000 UTC m=+511.388984283"
May 28 21:01:05.723356 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.723331    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:01:05.726523 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:05.726499    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44fvqfv"]
May 28 21:01:06.917444 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:06.917410    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" path="/var/lib/kubelet/pods/a76e5dc6-05ab-4505-9b29-35c14b8f8aed/volumes"
May 28 21:01:13.063539 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:13.063510    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:13.063539 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:13.063549    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:13.085796 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:13.085768    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:13.750016 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:13.749987    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ljcvz"
May 28 21:01:17.157695 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.157662    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"]
May 28 21:01:17.158072 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.158003    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy"
May 28 21:01:17.158072 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.158015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy"
May 28 21:01:17.158145 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.158081    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a76e5dc6-05ab-4505-9b29-35c14b8f8aed" containerName="istio-proxy"
May 28 21:01:17.162374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.162357    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.166484 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.166282    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzdn6\""
May 28 21:01:17.168352 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.168329    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"]
May 28 21:01:17.305535 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.305506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.305650 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.305540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srq4c\" (UniqueName: \"kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.305650 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.305611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.406730 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.406697    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.406730 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.406734    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srq4c\" (UniqueName: \"kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.406937 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.406808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.407133 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.407114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.407175 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.407131    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.415701 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.415647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srq4c\" (UniqueName: \"kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.473302 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.473277    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:17.600456 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.600430    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"]
May 28 21:01:17.602610 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:17.602582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a10622b_8061_48c0_afd7_8cac0d5bb3e9.slice/crio-03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492 WatchSource:0}: Error finding container 03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492: Status 404 returned error can't find the container with id 03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492
May 28 21:01:17.744582 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.744548    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerID="631497abbed0ae3c0c95f82b31214f71738fc3f3269eb880ac24ba2840e3af95" exitCode=0
May 28 21:01:17.744704 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.744594    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds" event={"ID":"5a10622b-8061-48c0-afd7-8cac0d5bb3e9","Type":"ContainerDied","Data":"631497abbed0ae3c0c95f82b31214f71738fc3f3269eb880ac24ba2840e3af95"}
May 28 21:01:17.744704 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.744633    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds" event={"ID":"5a10622b-8061-48c0-afd7-8cac0d5bb3e9","Type":"ContainerStarted","Data":"03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492"}
May 28 21:01:17.752032 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.752009    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"]
May 28 21:01:17.755823 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.755806    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:17.763312 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.763290    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"]
May 28 21:01:17.911502 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.911473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9v5r\" (UniqueName: \"kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:17.911622 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.911508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:17.911622 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:17.911530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.012785 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.012686    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.012785 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.012724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.012961 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.012830    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9v5r\" (UniqueName: \"kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.013150 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.013132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.013200 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.013183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.022304 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.022278    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9v5r\" (UniqueName: \"kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.072823 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.072783    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:18.200105 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.200073    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"]
May 28 21:01:18.202435 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:18.202408    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda140d23f_0871_40f5_a87d_065b200ba0b3.slice/crio-0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5 WatchSource:0}: Error finding container 0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5: Status 404 returned error can't find the container with id 0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5
May 28 21:01:18.351983 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.351953    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"]
May 28 21:01:18.355635 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.355613    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.362477 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.362447    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"]
May 28 21:01:18.517506 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.517436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.517608 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.517583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.517652 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.517627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgwh\" (UniqueName: \"kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.618982 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.618950    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgwh\" (UniqueName: \"kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.619096 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.619011    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.619158 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.619123    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.619285 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.619264    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.619405 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.619387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.627770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.627722    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgwh\" (UniqueName: \"kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.672562 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.672541    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:18.749335 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.749304    2562 generic.go:358] "Generic (PLEG): container finished" podID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerID="5e1c191ec8f28bd1e0022f2dfb1093469940cad525c6b7cf2ec9629c305ec474" exitCode=0
May 28 21:01:18.749481 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.749397    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6" event={"ID":"a140d23f-0871-40f5-a87d-065b200ba0b3","Type":"ContainerDied","Data":"5e1c191ec8f28bd1e0022f2dfb1093469940cad525c6b7cf2ec9629c305ec474"}
May 28 21:01:18.749481 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.749440    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6" event={"ID":"a140d23f-0871-40f5-a87d-065b200ba0b3","Type":"ContainerStarted","Data":"0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5"}
May 28 21:01:18.751321 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.751294    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerID="6ef9eb45da45e3d9b7ca458522c48dc10053e47d4c64a9b7fe471e2059f123cb" exitCode=0
May 28 21:01:18.751430 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.751332    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds" event={"ID":"5a10622b-8061-48c0-afd7-8cac0d5bb3e9","Type":"ContainerDied","Data":"6ef9eb45da45e3d9b7ca458522c48dc10053e47d4c64a9b7fe471e2059f123cb"}
May 28 21:01:18.758694 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.758666    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"]
May 28 21:01:18.762375 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.762355    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:18.769715 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.769627    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"]
May 28 21:01:18.815183 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.815158    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"]
May 28 21:01:18.817592 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:18.817570    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda434caa_b887_4603_ba4c_50a08d275d76.slice/crio-34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2 WatchSource:0}: Error finding container 34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2: Status 404 returned error can't find the container with id 34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2
May 28 21:01:18.921477 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.921444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:18.921629 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.921485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:18.921629 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:18.921522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrm8\" (UniqueName: \"kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.022738 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.022672    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.022738 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.022715    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.022949 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.022805    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrm8\" (UniqueName: \"kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.023044 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.023029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.023085 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.023058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.033234 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.033205    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrm8\" (UniqueName: \"kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.076329 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.076302    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:19.202973 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.202946    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"]
May 28 21:01:19.205951 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:19.205926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c71f884_6909_4660_a49d_fb40e9efb9ca.slice/crio-fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b WatchSource:0}: Error finding container fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b: Status 404 returned error can't find the container with id fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b
May 28 21:01:19.756528 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.756500    2562 generic.go:358] "Generic (PLEG): container finished" podID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerID="0f0aa928eb13e326f4ddd7a581af0cbcc8dea7b1eb292d2809ebc3f07d723d70" exitCode=0
May 28 21:01:19.756625 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.756585    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58" event={"ID":"9c71f884-6909-4660-a49d-fb40e9efb9ca","Type":"ContainerDied","Data":"0f0aa928eb13e326f4ddd7a581af0cbcc8dea7b1eb292d2809ebc3f07d723d70"}
May 28 21:01:19.756687 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.756625    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58" event={"ID":"9c71f884-6909-4660-a49d-fb40e9efb9ca","Type":"ContainerStarted","Data":"fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b"}
May 28 21:01:19.758030 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.758005    2562 generic.go:358] "Generic (PLEG): container finished" podID="da434caa-b887-4603-ba4c-50a08d275d76" containerID="69c56db816a83c9d9ac74cc6f3252a58e218d85689567c3c94fd83bc76fb2ffb" exitCode=0
May 28 21:01:19.758141 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.758089    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf" event={"ID":"da434caa-b887-4603-ba4c-50a08d275d76","Type":"ContainerDied","Data":"69c56db816a83c9d9ac74cc6f3252a58e218d85689567c3c94fd83bc76fb2ffb"}
May 28 21:01:19.758141 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.758126    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf" event={"ID":"da434caa-b887-4603-ba4c-50a08d275d76","Type":"ContainerStarted","Data":"34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2"}
May 28 21:01:19.759945 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.759924    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerID="4a987c3ae53119a42d80d917e8e05c6324494980a607bda0f56bf4f44c81038b" exitCode=0
May 28 21:01:19.760065 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:19.759945    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds" event={"ID":"5a10622b-8061-48c0-afd7-8cac0d5bb3e9","Type":"ContainerDied","Data":"4a987c3ae53119a42d80d917e8e05c6324494980a607bda0f56bf4f44c81038b"}
May 28 21:01:20.776021 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:20.775989    2562 generic.go:358] "Generic (PLEG): container finished" podID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerID="54149d4d7fe53441d47f721acd36d6b39167c183c651d75c0c0c3f9f467b653b" exitCode=0
May 28 21:01:20.776406 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:20.776041    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6" event={"ID":"a140d23f-0871-40f5-a87d-065b200ba0b3","Type":"ContainerDied","Data":"54149d4d7fe53441d47f721acd36d6b39167c183c651d75c0c0c3f9f467b653b"}
May 28 21:01:20.911169 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:20.911144    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:21.044631 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.044554    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srq4c\" (UniqueName: \"kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c\") pod \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") "
May 28 21:01:21.044631 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.044614    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util\") pod \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") "
May 28 21:01:21.044631 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.044630    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle\") pod \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\" (UID: \"5a10622b-8061-48c0-afd7-8cac0d5bb3e9\") "
May 28 21:01:21.045154 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.045128    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle" (OuterVolumeSpecName: "bundle") pod "5a10622b-8061-48c0-afd7-8cac0d5bb3e9" (UID: "5a10622b-8061-48c0-afd7-8cac0d5bb3e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:21.046847 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.046823    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c" (OuterVolumeSpecName: "kube-api-access-srq4c") pod "5a10622b-8061-48c0-afd7-8cac0d5bb3e9" (UID: "5a10622b-8061-48c0-afd7-8cac0d5bb3e9"). InnerVolumeSpecName "kube-api-access-srq4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:21.050195 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.050170    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util" (OuterVolumeSpecName: "util") pod "5a10622b-8061-48c0-afd7-8cac0d5bb3e9" (UID: "5a10622b-8061-48c0-afd7-8cac0d5bb3e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:21.145533 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.145503    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srq4c\" (UniqueName: \"kubernetes.io/projected/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-kube-api-access-srq4c\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:21.145533 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.145531    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:21.145533 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.145542    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a10622b-8061-48c0-afd7-8cac0d5bb3e9-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:21.781676 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.781649    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds"
May 28 21:01:21.782104 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.781649    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds" event={"ID":"5a10622b-8061-48c0-afd7-8cac0d5bb3e9","Type":"ContainerDied","Data":"03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492"}
May 28 21:01:21.782104 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.781745    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03aed4707ab025eb3558f17d3b7a10f3da1f85c3155e544922485f681d1a7492"
May 28 21:01:21.783595 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.783573    2562 generic.go:358] "Generic (PLEG): container finished" podID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerID="b8be9e2bfba53e2a2abe791db7444dfe81475b261a855fb813de78404cc05804" exitCode=0
May 28 21:01:21.783697 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.783651    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6" event={"ID":"a140d23f-0871-40f5-a87d-065b200ba0b3","Type":"ContainerDied","Data":"b8be9e2bfba53e2a2abe791db7444dfe81475b261a855fb813de78404cc05804"}
May 28 21:01:21.785250 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.785229    2562 generic.go:358] "Generic (PLEG): container finished" podID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerID="4da52d33e75675d514bcaf5353beadf8ad2d3b5cb05f02ab6f0c3e3f23d9cc80" exitCode=0
May 28 21:01:21.785346 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.785292    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58" event={"ID":"9c71f884-6909-4660-a49d-fb40e9efb9ca","Type":"ContainerDied","Data":"4da52d33e75675d514bcaf5353beadf8ad2d3b5cb05f02ab6f0c3e3f23d9cc80"}
May 28 21:01:21.787057 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.786989    2562 generic.go:358] "Generic (PLEG): container finished" podID="da434caa-b887-4603-ba4c-50a08d275d76" containerID="87144218ff332e703edfc597319fa550423cac2a3a62987a7e083609b94cf4d2" exitCode=0
May 28 21:01:21.787057 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:21.787039    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf" event={"ID":"da434caa-b887-4603-ba4c-50a08d275d76","Type":"ContainerDied","Data":"87144218ff332e703edfc597319fa550423cac2a3a62987a7e083609b94cf4d2"}
May 28 21:01:22.792884 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:22.792845    2562 generic.go:358] "Generic (PLEG): container finished" podID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerID="1f86f934b0bfe4c2749ab56d32ef15b4a6e3bade1c623b7f08c4cb39b71e44a3" exitCode=0
May 28 21:01:22.793292 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:22.792924    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58" event={"ID":"9c71f884-6909-4660-a49d-fb40e9efb9ca","Type":"ContainerDied","Data":"1f86f934b0bfe4c2749ab56d32ef15b4a6e3bade1c623b7f08c4cb39b71e44a3"}
May 28 21:01:22.794725 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:22.794702    2562 generic.go:358] "Generic (PLEG): container finished" podID="da434caa-b887-4603-ba4c-50a08d275d76" containerID="595475c54803caeca9422c6535087645519025d3e8b77f11c5c49a842e4f5059" exitCode=0
May 28 21:01:22.794880 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:22.794795    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf" event={"ID":"da434caa-b887-4603-ba4c-50a08d275d76","Type":"ContainerDied","Data":"595475c54803caeca9422c6535087645519025d3e8b77f11c5c49a842e4f5059"}
May 28 21:01:22.925068 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:22.925048    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:23.062116 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.062028    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle\") pod \"a140d23f-0871-40f5-a87d-065b200ba0b3\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") "
May 28 21:01:23.062116 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.062071    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util\") pod \"a140d23f-0871-40f5-a87d-065b200ba0b3\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") "
May 28 21:01:23.062333 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.062177    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9v5r\" (UniqueName: \"kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r\") pod \"a140d23f-0871-40f5-a87d-065b200ba0b3\" (UID: \"a140d23f-0871-40f5-a87d-065b200ba0b3\") "
May 28 21:01:23.062431 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.062406    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle" (OuterVolumeSpecName: "bundle") pod "a140d23f-0871-40f5-a87d-065b200ba0b3" (UID: "a140d23f-0871-40f5-a87d-065b200ba0b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:23.062509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.062495    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:23.064481 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.064453    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r" (OuterVolumeSpecName: "kube-api-access-d9v5r") pod "a140d23f-0871-40f5-a87d-065b200ba0b3" (UID: "a140d23f-0871-40f5-a87d-065b200ba0b3"). InnerVolumeSpecName "kube-api-access-d9v5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:23.067635 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.067608    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util" (OuterVolumeSpecName: "util") pod "a140d23f-0871-40f5-a87d-065b200ba0b3" (UID: "a140d23f-0871-40f5-a87d-065b200ba0b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:23.163604 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.163570    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9v5r\" (UniqueName: \"kubernetes.io/projected/a140d23f-0871-40f5-a87d-065b200ba0b3-kube-api-access-d9v5r\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:23.163604 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.163600    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a140d23f-0871-40f5-a87d-065b200ba0b3-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:23.800652 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.800619    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6"
May 28 21:01:23.801139 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.800666    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6" event={"ID":"a140d23f-0871-40f5-a87d-065b200ba0b3","Type":"ContainerDied","Data":"0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5"}
May 28 21:01:23.801139 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.800692    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0005f40623bbbaa2ce1aba914e1d6081887e498ca28c1979048175f98a8716d5"
May 28 21:01:23.938829 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.938807    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:23.971573 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:23.971552    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:24.070714 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070633    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util\") pod \"9c71f884-6909-4660-a49d-fb40e9efb9ca\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") "
May 28 21:01:24.070714 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070715    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle\") pod \"9c71f884-6909-4660-a49d-fb40e9efb9ca\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") "
May 28 21:01:24.070940 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070742    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrm8\" (UniqueName: \"kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8\") pod \"9c71f884-6909-4660-a49d-fb40e9efb9ca\" (UID: \"9c71f884-6909-4660-a49d-fb40e9efb9ca\") "
May 28 21:01:24.070940 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070814    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle\") pod \"da434caa-b887-4603-ba4c-50a08d275d76\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") "
May 28 21:01:24.070940 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070892    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtgwh\" (UniqueName: \"kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh\") pod \"da434caa-b887-4603-ba4c-50a08d275d76\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") "
May 28 21:01:24.070940 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.070924    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util\") pod \"da434caa-b887-4603-ba4c-50a08d275d76\" (UID: \"da434caa-b887-4603-ba4c-50a08d275d76\") "
May 28 21:01:24.071490 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.071463    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle" (OuterVolumeSpecName: "bundle") pod "9c71f884-6909-4660-a49d-fb40e9efb9ca" (UID: "9c71f884-6909-4660-a49d-fb40e9efb9ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:24.071814 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.071463    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle" (OuterVolumeSpecName: "bundle") pod "da434caa-b887-4603-ba4c-50a08d275d76" (UID: "da434caa-b887-4603-ba4c-50a08d275d76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:24.071814 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.071649    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.073143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.073118    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8" (OuterVolumeSpecName: "kube-api-access-pkrm8") pod "9c71f884-6909-4660-a49d-fb40e9efb9ca" (UID: "9c71f884-6909-4660-a49d-fb40e9efb9ca"). InnerVolumeSpecName "kube-api-access-pkrm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:24.073235 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.073175    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh" (OuterVolumeSpecName: "kube-api-access-qtgwh") pod "da434caa-b887-4603-ba4c-50a08d275d76" (UID: "da434caa-b887-4603-ba4c-50a08d275d76"). InnerVolumeSpecName "kube-api-access-qtgwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:24.075862 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.075841    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util" (OuterVolumeSpecName: "util") pod "9c71f884-6909-4660-a49d-fb40e9efb9ca" (UID: "9c71f884-6909-4660-a49d-fb40e9efb9ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:24.173012 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.172983    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.173012 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.173011    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtgwh\" (UniqueName: \"kubernetes.io/projected/da434caa-b887-4603-ba4c-50a08d275d76-kube-api-access-qtgwh\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.173174 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.173023    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c71f884-6909-4660-a49d-fb40e9efb9ca-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.173174 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.173032    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrm8\" (UniqueName: \"kubernetes.io/projected/9c71f884-6909-4660-a49d-fb40e9efb9ca-kube-api-access-pkrm8\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.211133 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.211092    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util" (OuterVolumeSpecName: "util") pod "da434caa-b887-4603-ba4c-50a08d275d76" (UID: "da434caa-b887-4603-ba4c-50a08d275d76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:24.274277 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.274251    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da434caa-b887-4603-ba4c-50a08d275d76-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:24.806223 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.806183    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58" event={"ID":"9c71f884-6909-4660-a49d-fb40e9efb9ca","Type":"ContainerDied","Data":"fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b"}
May 28 21:01:24.806223 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.806219    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbc6e8d940889a7b1723eeadd928329d320ca5b1e3588235d56a57d8102db70b"
May 28 21:01:24.806223 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.806225    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58"
May 28 21:01:24.807728 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.807704    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf" event={"ID":"da434caa-b887-4603-ba4c-50a08d275d76","Type":"ContainerDied","Data":"34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2"}
May 28 21:01:24.807728 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.807728    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c0a4ad130ed01c498e8803fc2f5070209e649ad965ff01d1312803c59ccff2"
May 28 21:01:24.807934 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:24.807795    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf"
May 28 21:01:27.004799 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.004762    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c6d6f6dd-zn87b"]
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005110    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005125    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005137    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005190    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005212    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="extract"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="extract"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005242    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005248    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005255    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005260    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="pull"
May 28 21:01:27.005286 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005287    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005311    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005347    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005371    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005382    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005432    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005459    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005467    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005502    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005542    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005551    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005572    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005581    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="util"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005688    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c71f884-6909-4660-a49d-fb40e9efb9ca" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005702    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="da434caa-b887-4603-ba4c-50a08d275d76" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005713    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a10622b-8061-48c0-afd7-8cac0d5bb3e9" containerName="extract"
May 28 21:01:27.005890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.005728    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a140d23f-0871-40f5-a87d-065b200ba0b3" containerName="extract"
May 28 21:01:27.014183 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.014163    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.018617 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.018593    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c6d6f6dd-zn87b"]
May 28 21:01:27.201349 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4lh\" (UniqueName: \"kubernetes.io/projected/1afd30ac-69b8-4385-b60a-007e6ad1bff2-kube-api-access-2n4lh\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-oauth-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-trusted-ca-bundle\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201654 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-service-ca\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.201654 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.201604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-oauth-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303102 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303018    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-oauth-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303102 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303059    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-trusted-ca-bundle\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303302 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303302 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303226    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303302 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303265    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-service-ca\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303455 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303309    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-oauth-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303455 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303405    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4lh\" (UniqueName: \"kubernetes.io/projected/1afd30ac-69b8-4385-b60a-007e6ad1bff2-kube-api-access-2n4lh\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.303911 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303883    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.304058 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.303990    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-oauth-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.304166 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.304144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-trusted-ca-bundle\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.304269 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.304246    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1afd30ac-69b8-4385-b60a-007e6ad1bff2-service-ca\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.305774 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.305740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-serving-cert\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.305872 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.305790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1afd30ac-69b8-4385-b60a-007e6ad1bff2-console-oauth-config\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.311624 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.311602    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4lh\" (UniqueName: \"kubernetes.io/projected/1afd30ac-69b8-4385-b60a-007e6ad1bff2-kube-api-access-2n4lh\") pod \"console-9c6d6f6dd-zn87b\" (UID: \"1afd30ac-69b8-4385-b60a-007e6ad1bff2\") " pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.326551 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.326530    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:27.461443 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.461411    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c6d6f6dd-zn87b"]
May 28 21:01:27.462718 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:27.462691    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afd30ac_69b8_4385_b60a_007e6ad1bff2.slice/crio-f79e59bc2e145405396ecc4ef60eeeecbbdcbdc0b80afcf94b8bbf72f0f54465 WatchSource:0}: Error finding container f79e59bc2e145405396ecc4ef60eeeecbbdcbdc0b80afcf94b8bbf72f0f54465: Status 404 returned error can't find the container with id f79e59bc2e145405396ecc4ef60eeeecbbdcbdc0b80afcf94b8bbf72f0f54465
May 28 21:01:27.820323 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.820281    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d6f6dd-zn87b" event={"ID":"1afd30ac-69b8-4385-b60a-007e6ad1bff2","Type":"ContainerStarted","Data":"8de0c83adb95637a8716a57f9412a48e5359adc682b9f865e1ed5faa05542588"}
May 28 21:01:27.820323 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.820327    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d6f6dd-zn87b" event={"ID":"1afd30ac-69b8-4385-b60a-007e6ad1bff2","Type":"ContainerStarted","Data":"f79e59bc2e145405396ecc4ef60eeeecbbdcbdc0b80afcf94b8bbf72f0f54465"}
May 28 21:01:27.840037 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:27.839990    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9c6d6f6dd-zn87b" podStartSLOduration=1.839978224 podStartE2EDuration="1.839978224s" podCreationTimestamp="2026-05-28 21:01:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 21:01:27.837852041 +0000 UTC m=+533.515555461" watchObservedRunningTime="2026-05-28 21:01:27.839978224 +0000 UTC m=+533.517681644"
May 28 21:01:32.638363 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.638326    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"]
May 28 21:01:32.642091 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.642075    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:32.644785 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.644745    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 21:01:32.644902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.644884    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lr5sd\""
May 28 21:01:32.649022 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.648861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdgr\" (UniqueName: \"kubernetes.io/projected/b1a2da43-6d8d-4f02-83ce-9ecff0466a2b-kube-api-access-frdgr\") pod \"dns-operator-controller-manager-648d5c98bc-vm4gw\" (UID: \"b1a2da43-6d8d-4f02-83ce-9ecff0466a2b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:32.652128 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.652103    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"]
May 28 21:01:32.749996 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.749962    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frdgr\" (UniqueName: \"kubernetes.io/projected/b1a2da43-6d8d-4f02-83ce-9ecff0466a2b-kube-api-access-frdgr\") pod \"dns-operator-controller-manager-648d5c98bc-vm4gw\" (UID: \"b1a2da43-6d8d-4f02-83ce-9ecff0466a2b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:32.771607 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.771576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdgr\" (UniqueName: \"kubernetes.io/projected/b1a2da43-6d8d-4f02-83ce-9ecff0466a2b-kube-api-access-frdgr\") pod \"dns-operator-controller-manager-648d5c98bc-vm4gw\" (UID: \"b1a2da43-6d8d-4f02-83ce-9ecff0466a2b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:32.953585 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:32.953509    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:33.092360 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:33.092332    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"]
May 28 21:01:33.094419 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:33.094394    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a2da43_6d8d_4f02_83ce_9ecff0466a2b.slice/crio-7c833ccaf54161231d3a1360e5d6252f70f28a72376400cd98a0e33618e0322e WatchSource:0}: Error finding container 7c833ccaf54161231d3a1360e5d6252f70f28a72376400cd98a0e33618e0322e: Status 404 returned error can't find the container with id 7c833ccaf54161231d3a1360e5d6252f70f28a72376400cd98a0e33618e0322e
May 28 21:01:33.845645 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:33.845609    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw" event={"ID":"b1a2da43-6d8d-4f02-83ce-9ecff0466a2b","Type":"ContainerStarted","Data":"7c833ccaf54161231d3a1360e5d6252f70f28a72376400cd98a0e33618e0322e"}
May 28 21:01:35.530541 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:35.530518    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 21:01:35.854189 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:35.854148    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw" event={"ID":"b1a2da43-6d8d-4f02-83ce-9ecff0466a2b","Type":"ContainerStarted","Data":"7316ea5319bfe654ac17a712e9ce662636815ab1baac9d5c456fa59726792b17"}
May 28 21:01:35.854347 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:35.854308    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:35.891459 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:35.891407    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw" podStartSLOduration=1.46030586 podStartE2EDuration="3.891389618s" podCreationTimestamp="2026-05-28 21:01:32 +0000 UTC" firstStartedPulling="2026-05-28 21:01:33.096384019 +0000 UTC m=+538.774087418" lastFinishedPulling="2026-05-28 21:01:35.527467773 +0000 UTC m=+541.205171176" observedRunningTime="2026-05-28 21:01:35.889970521 +0000 UTC m=+541.567673954" watchObservedRunningTime="2026-05-28 21:01:35.891389618 +0000 UTC m=+541.569093038"
May 28 21:01:37.327220 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:37.327192    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:37.327704 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:37.327235    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:37.331860 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:37.331838    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:37.865280 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:37.865244    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9c6d6f6dd-zn87b"
May 28 21:01:37.947408 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:37.947375    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 21:01:38.026322 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.026291    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"]
May 28 21:01:38.031074 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.031051    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.033886 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.033867    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t4hzt\""
May 28 21:01:38.044000 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.043976    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"]
May 28 21:01:38.096197 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.096166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.096357 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.096227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72jtt\" (UniqueName: \"kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.197634 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.197544    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.197634 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.197601    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72jtt\" (UniqueName: \"kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.197965 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.197946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.209799 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.209772    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72jtt\" (UniqueName: \"kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.342476 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.342445    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:38.485993 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.485960    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"]
May 28 21:01:38.487484 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:38.487453    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52a64c1_cade_425e_aa3e_ff19ad1c872d.slice/crio-e4fc03abfcce378ddd892091139de4de1b3e5770b7e6317e0859679eb4d32af1 WatchSource:0}: Error finding container e4fc03abfcce378ddd892091139de4de1b3e5770b7e6317e0859679eb4d32af1: Status 404 returned error can't find the container with id e4fc03abfcce378ddd892091139de4de1b3e5770b7e6317e0859679eb4d32af1
May 28 21:01:38.866626 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:38.866598    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" event={"ID":"d52a64c1-cade-425e-aa3e-ff19ad1c872d","Type":"ContainerStarted","Data":"e4fc03abfcce378ddd892091139de4de1b3e5770b7e6317e0859679eb4d32af1"}
May 28 21:01:44.892717 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:44.892671    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" event={"ID":"d52a64c1-cade-425e-aa3e-ff19ad1c872d","Type":"ContainerStarted","Data":"cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989"}
May 28 21:01:44.893294 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:44.892809    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:44.916089 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:44.916035    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" podStartSLOduration=1.009925064 podStartE2EDuration="6.916018358s" podCreationTimestamp="2026-05-28 21:01:38 +0000 UTC" firstStartedPulling="2026-05-28 21:01:38.489776569 +0000 UTC m=+544.167479970" lastFinishedPulling="2026-05-28 21:01:44.395869863 +0000 UTC m=+550.073573264" observedRunningTime="2026-05-28 21:01:44.911892381 +0000 UTC m=+550.589595803" watchObservedRunningTime="2026-05-28 21:01:44.916018358 +0000 UTC m=+550.593721781"
May 28 21:01:46.861118 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:46.861091    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-vm4gw"
May 28 21:01:47.405997 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.405963    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"]
May 28 21:01:47.409405 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.409389    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.413260 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.413238    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 28 21:01:47.413822 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.413805    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 28 21:01:47.414462 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.414450    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzdn6\""
May 28 21:01:47.424678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.424649    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"]
May 28 21:01:47.492684 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.492650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a97e3997-03a6-4dac-9b1c-6c970662c2c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.492890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.492717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6565f\" (UniqueName: \"kubernetes.io/projected/a97e3997-03a6-4dac-9b1c-6c970662c2c3-kube-api-access-6565f\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.492890 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.492803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.593992 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.593955    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6565f\" (UniqueName: \"kubernetes.io/projected/a97e3997-03a6-4dac-9b1c-6c970662c2c3-kube-api-access-6565f\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.594165 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.594014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.594165 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.594085    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a97e3997-03a6-4dac-9b1c-6c970662c2c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.594165 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:01:47.594111    2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
May 28 21:01:47.594325 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:01:47.594181    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert podName:a97e3997-03a6-4dac-9b1c-6c970662c2c3 nodeName:}" failed. No retries permitted until 2026-05-28 21:01:48.094162877 +0000 UTC m=+553.771866280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-jvsgc" (UID: "a97e3997-03a6-4dac-9b1c-6c970662c2c3") : secret "plugin-serving-cert" not found
May 28 21:01:47.594878 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.594858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a97e3997-03a6-4dac-9b1c-6c970662c2c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:47.607894 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:47.607872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6565f\" (UniqueName: \"kubernetes.io/projected/a97e3997-03a6-4dac-9b1c-6c970662c2c3-kube-api-access-6565f\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:48.098832 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:48.098798    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:48.101404 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:48.101382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a97e3997-03a6-4dac-9b1c-6c970662c2c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-jvsgc\" (UID: \"a97e3997-03a6-4dac-9b1c-6c970662c2c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:48.319406 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:48.319379    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"
May 28 21:01:48.448889 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:48.448862    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc"]
May 28 21:01:48.450671 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:01:48.450644    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda97e3997_03a6_4dac_9b1c_6c970662c2c3.slice/crio-83bb0abc263370bdf601614803246e190e917d6752afa34d28ea979eda8c46e3 WatchSource:0}: Error finding container 83bb0abc263370bdf601614803246e190e917d6752afa34d28ea979eda8c46e3: Status 404 returned error can't find the container with id 83bb0abc263370bdf601614803246e190e917d6752afa34d28ea979eda8c46e3
May 28 21:01:48.910046 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:48.910011    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc" event={"ID":"a97e3997-03a6-4dac-9b1c-6c970662c2c3","Type":"ContainerStarted","Data":"83bb0abc263370bdf601614803246e190e917d6752afa34d28ea979eda8c46e3"}
May 28 21:01:55.898926 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:55.898892    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:57.602518 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.602468    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"]
May 28 21:01:57.603033 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.602716    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" containerName="manager" containerID="cri-o://cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989" gracePeriod=2
May 28 21:01:57.605499 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.605461    2562 status_manager.go:895] "Failed to get status for pod" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" is forbidden: User \"system:node:ip-10-0-133-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-41.ec2.internal' and this object"
May 28 21:01:57.607348 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.607323    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"]
May 28 21:01:57.627118 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.627080    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:01:57.627700 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.627596    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" containerName="manager"
May 28 21:01:57.627700 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.627618    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" containerName="manager"
May 28 21:01:57.627889 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.627771    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" containerName="manager"
May 28 21:01:57.631264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.631245    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.646044 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.646019    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:01:57.662949 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.662906    2562 status_manager.go:895] "Failed to get status for pod" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" is forbidden: User \"system:node:ip-10-0-133-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-41.ec2.internal' and this object"
May 28 21:01:57.792240 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.792211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhcd\" (UniqueName: \"kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.792364 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.792271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.849460 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.849442    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:57.851785 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.851744    2562 status_manager.go:895] "Failed to get status for pod" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" is forbidden: User \"system:node:ip-10-0-133-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-41.ec2.internal' and this object"
May 28 21:01:57.893054 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.892986    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhcd\" (UniqueName: \"kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.893210 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.893053    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.893428 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.893407    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.900966 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.900944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhcd\" (UniqueName: \"kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-d4749\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.957631 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.957601    2562 generic.go:358] "Generic (PLEG): container finished" podID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" containerID="cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989" exitCode=0
May 28 21:01:57.957761 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.957643    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf"
May 28 21:01:57.957761 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.957702    2562 scope.go:117] "RemoveContainer" containerID="cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989"
May 28 21:01:57.960160 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.960133    2562 status_manager.go:895] "Failed to get status for pod" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" is forbidden: User \"system:node:ip-10-0-133-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-41.ec2.internal' and this object"
May 28 21:01:57.966272 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.966256    2562 scope.go:117] "RemoveContainer" containerID="cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989"
May 28 21:01:57.966535 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:01:57.966517    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989\": container with ID starting with cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989 not found: ID does not exist" containerID="cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989"
May 28 21:01:57.966579 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.966543    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989"} err="failed to get container status \"cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989\": rpc error: code = NotFound desc = could not find container \"cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989\": container with ID starting with cb8d777e7b63264f83ad510ff26d0fc49c012468fd34b8f2c20d8c1a03c39989 not found: ID does not exist"
May 28 21:01:57.978769 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.978729    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:01:57.993792 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.993738    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72jtt\" (UniqueName: \"kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt\") pod \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") "
May 28 21:01:57.993902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.993828    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume\") pod \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\" (UID: \"d52a64c1-cade-425e-aa3e-ff19ad1c872d\") "
May 28 21:01:57.994580 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.994549    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d52a64c1-cade-425e-aa3e-ff19ad1c872d" (UID: "d52a64c1-cade-425e-aa3e-ff19ad1c872d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:01:57.995905 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:57.995878    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt" (OuterVolumeSpecName: "kube-api-access-72jtt") pod "d52a64c1-cade-425e-aa3e-ff19ad1c872d" (UID: "d52a64c1-cade-425e-aa3e-ff19ad1c872d"). InnerVolumeSpecName "kube-api-access-72jtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:01:58.095021 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:58.094962    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72jtt\" (UniqueName: \"kubernetes.io/projected/d52a64c1-cade-425e-aa3e-ff19ad1c872d-kube-api-access-72jtt\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:58.095021 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:58.094997    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d52a64c1-cade-425e-aa3e-ff19ad1c872d-extensions-socket-volume\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:01:58.147239 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:58.147212    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:01:58.269269 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:58.269227    2562 status_manager.go:895] "Failed to get status for pod" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cbbbf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cbbbf\" is forbidden: User \"system:node:ip-10-0-133-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-41.ec2.internal' and this object"
May 28 21:01:58.918313 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:01:58.918244    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d52a64c1-cade-425e-aa3e-ff19ad1c872d" path="/var/lib/kubelet/pods/d52a64c1-cade-425e-aa3e-ff19ad1c872d/volumes"
May 28 21:02:02.968375 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:02.968311    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-844796c6d7-g55g2" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerName="console" containerID="cri-o://c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af" gracePeriod=15
May 28 21:02:11.921474 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:11.921438    2562 patch_prober.go:28] interesting pod/console-844796c6d7-g55g2 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body=
May 28 21:02:11.921912 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:11.921492    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-844796c6d7-g55g2" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused"
May 28 21:02:12.583114 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:02:12.583064    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a5e7ba_fbb5_4b39_ab09_3f48fc3f431c.slice/crio-3f339a891809831fc41990b47ccac4496d0528290b886cc319909ff3c7bb5fd8 WatchSource:0}: Error finding container 3f339a891809831fc41990b47ccac4496d0528290b886cc319909ff3c7bb5fd8: Status 404 returned error can't find the container with id 3f339a891809831fc41990b47ccac4496d0528290b886cc319909ff3c7bb5fd8
May 28 21:02:12.750117 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.750098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844796c6d7-g55g2_5929abf3-8f49-45d5-91e7-1a6a53175948/console/0.log"
May 28 21:02:12.750208 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.750160    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844796c6d7-g55g2"
May 28 21:02:12.837189 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837129    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837189 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837161    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837189 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837182    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837460 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837210    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837460 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837248    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837460 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837277    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdcvq\" (UniqueName: \"kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837460 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837335    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca\") pod \"5929abf3-8f49-45d5-91e7-1a6a53175948\" (UID: \"5929abf3-8f49-45d5-91e7-1a6a53175948\") "
May 28 21:02:12.837671 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837525    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config" (OuterVolumeSpecName: "console-config") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:02:12.837671 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837543    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:02:12.837820 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837784    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:02:12.837820 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837794    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-console-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.838107 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837823    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-oauth-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.838107 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.837834    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca" (OuterVolumeSpecName: "service-ca") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:02:12.839633 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.839613    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 21:02:12.839731 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.839632    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq" (OuterVolumeSpecName: "kube-api-access-tdcvq") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "kube-api-access-tdcvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:02:12.839731 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.839670    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5929abf3-8f49-45d5-91e7-1a6a53175948" (UID: "5929abf3-8f49-45d5-91e7-1a6a53175948"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 21:02:12.939228 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.939200    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-serving-cert\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.939228 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.939225    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-trusted-ca-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.939561 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.939235    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdcvq\" (UniqueName: \"kubernetes.io/projected/5929abf3-8f49-45d5-91e7-1a6a53175948-kube-api-access-tdcvq\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.939561 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.939246    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929abf3-8f49-45d5-91e7-1a6a53175948-service-ca\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:12.939561 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:12.939255    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929abf3-8f49-45d5-91e7-1a6a53175948-console-oauth-config\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:13.024452 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.024416    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" event={"ID":"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c","Type":"ContainerStarted","Data":"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"}
May 28 21:02:13.024572 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.024456    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" event={"ID":"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c","Type":"ContainerStarted","Data":"3f339a891809831fc41990b47ccac4496d0528290b886cc319909ff3c7bb5fd8"}
May 28 21:02:13.024572 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.024524    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:02:13.025888 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.025871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844796c6d7-g55g2_5929abf3-8f49-45d5-91e7-1a6a53175948/console/0.log"
May 28 21:02:13.025996 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.025904    2562 generic.go:358] "Generic (PLEG): container finished" podID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerID="c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af" exitCode=2
May 28 21:02:13.025996 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.025968    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844796c6d7-g55g2" event={"ID":"5929abf3-8f49-45d5-91e7-1a6a53175948","Type":"ContainerDied","Data":"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"}
May 28 21:02:13.025996 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.025975    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844796c6d7-g55g2"
May 28 21:02:13.025996 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.025988    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844796c6d7-g55g2" event={"ID":"5929abf3-8f49-45d5-91e7-1a6a53175948","Type":"ContainerDied","Data":"15dbd814edf4dd3a380778d1ffbaea7f739fdde301e173e727e0ed360338a567"}
May 28 21:02:13.026199 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.026004    2562 scope.go:117] "RemoveContainer" containerID="c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"
May 28 21:02:13.034332 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.034315    2562 scope.go:117] "RemoveContainer" containerID="c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"
May 28 21:02:13.034559 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:02:13.034539    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af\": container with ID starting with c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af not found: ID does not exist" containerID="c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"
May 28 21:02:13.034621 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.034565    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af"} err="failed to get container status \"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af\": rpc error: code = NotFound desc = could not find container \"c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af\": container with ID starting with c5e7cfb5c882c24f82ef0edc3836d1f163304412c0a00a2d680913d94a6e28af not found: ID does not exist"
May 28 21:02:13.045578 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.045539    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" podStartSLOduration=16.04552675 podStartE2EDuration="16.04552675s" podCreationTimestamp="2026-05-28 21:01:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 21:02:13.043160676 +0000 UTC m=+578.720864096" watchObservedRunningTime="2026-05-28 21:02:13.04552675 +0000 UTC m=+578.723230171"
May 28 21:02:13.064827 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.064789    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 21:02:13.067533 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:13.067496    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844796c6d7-g55g2"]
May 28 21:02:14.030767 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:14.030716    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc" event={"ID":"a97e3997-03a6-4dac-9b1c-6c970662c2c3","Type":"ContainerStarted","Data":"b2f20087971b1c86fdf9870b6756c2315a1f49994c48a8e17646a55abe0be501"}
May 28 21:02:14.053923 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:14.053880    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-jvsgc" podStartSLOduration=2.484243115 podStartE2EDuration="27.053867365s" podCreationTimestamp="2026-05-28 21:01:47 +0000 UTC" firstStartedPulling="2026-05-28 21:01:48.452094734 +0000 UTC m=+554.129798133" lastFinishedPulling="2026-05-28 21:02:13.021718967 +0000 UTC m=+578.699422383" observedRunningTime="2026-05-28 21:02:14.051937409 +0000 UTC m=+579.729640852" watchObservedRunningTime="2026-05-28 21:02:14.053867365 +0000 UTC m=+579.731570786"
May 28 21:02:14.755593 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:14.755560    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:02:14.917240 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:14.917188    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" path="/var/lib/kubelet/pods/5929abf3-8f49-45d5-91e7-1a6a53175948/volumes"
May 28 21:02:15.036117 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.036008    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" podUID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" containerName="manager" containerID="cri-o://9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c" gracePeriod=10
May 28 21:02:15.807054 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.807034    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:02:15.865738 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.865711    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhhcd\" (UniqueName: \"kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd\") pod \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") "
May 28 21:02:15.865900 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.865781    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume\") pod \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\" (UID: \"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c\") "
May 28 21:02:15.866184 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.866158    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" (UID: "44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:02:15.868001 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.867979    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd" (OuterVolumeSpecName: "kube-api-access-mhhcd") pod "44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" (UID: "44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c"). InnerVolumeSpecName "kube-api-access-mhhcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:02:15.967390 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.967317    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-extensions-socket-volume\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:15.967390 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:15.967346    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhhcd\" (UniqueName: \"kubernetes.io/projected/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c-kube-api-access-mhhcd\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:16.040618 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.040582    2562 generic.go:358] "Generic (PLEG): container finished" podID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" containerID="9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c" exitCode=0
May 28 21:02:16.041075 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.040688    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"
May 28 21:02:16.041075 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.040692    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" event={"ID":"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c","Type":"ContainerDied","Data":"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"}
May 28 21:02:16.041075 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.040730    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749" event={"ID":"44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c","Type":"ContainerDied","Data":"3f339a891809831fc41990b47ccac4496d0528290b886cc319909ff3c7bb5fd8"}
May 28 21:02:16.041075 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.040759    2562 scope.go:117] "RemoveContainer" containerID="9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"
May 28 21:02:16.050532 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.050518    2562 scope.go:117] "RemoveContainer" containerID="9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"
May 28 21:02:16.050780 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:02:16.050745    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c\": container with ID starting with 9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c not found: ID does not exist" containerID="9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"
May 28 21:02:16.050847 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.050791    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c"} err="failed to get container status \"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c\": rpc error: code = NotFound desc = could not find container \"9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c\": container with ID starting with 9d12b0abd464c25af9e121ffc0ffafdf9cf1cba8b91fe5ec1512dbd92ae2699c not found: ID does not exist"
May 28 21:02:16.069162 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.069142    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:02:16.072636 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.072618    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-d4749"]
May 28 21:02:16.917391 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:16.917361    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" path="/var/lib/kubelet/pods/44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c/volumes"
May 28 21:02:30.999164 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999130    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"]
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999451    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" containerName="manager"
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999461    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" containerName="manager"
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999473    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerName="console"
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999479    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerName="console"
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999543    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="44a5e7ba-fbb5-4b39-ab09-3f48fc3f431c" containerName="manager"
May 28 21:02:30.999639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:30.999554    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5929abf3-8f49-45d5-91e7-1a6a53175948" containerName="console"
May 28 21:02:31.002708 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.002636    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.005152 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.005127    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k8tsh\""
May 28 21:02:31.016916 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.016891    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"]
May 28 21:02:31.100489 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100663 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100663 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100663 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmlf6\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-kube-api-access-fmlf6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100663 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100929 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e032542b-cc68-465e-b836-86bac06e1f5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100929 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100929 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.100929 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.100891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e032542b-cc68-465e-b836-86bac06e1f5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202048 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202013    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202048 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202053    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202075    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202102    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmlf6\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-kube-api-access-fmlf6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202153    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202192    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e032542b-cc68-465e-b836-86bac06e1f5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202237    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202584 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202306    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e032542b-cc68-465e-b836-86bac06e1f5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202584 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202584 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202744 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.202744 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.202727    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.203059 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.203034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e032542b-cc68-465e-b836-86bac06e1f5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.204469 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.204453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e032542b-cc68-465e-b836-86bac06e1f5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.204928 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.204908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e032542b-cc68-465e-b836-86bac06e1f5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.210884 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.210860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmlf6\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-kube-api-access-fmlf6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.211020 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.210999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e032542b-cc68-465e-b836-86bac06e1f5e-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mhbh7\" (UID: \"e032542b-cc68-465e-b836-86bac06e1f5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.315230 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.315163    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:31.449583 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.449559    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"]
May 28 21:02:31.451858 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:02:31.451833    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode032542b_cc68_465e_b836_86bac06e1f5e.slice/crio-b068a769c4858965c26f81a9dbaf4ee93efd6196c82a3223181a952ecfeb04c6 WatchSource:0}: Error finding container b068a769c4858965c26f81a9dbaf4ee93efd6196c82a3223181a952ecfeb04c6: Status 404 returned error can't find the container with id b068a769c4858965c26f81a9dbaf4ee93efd6196c82a3223181a952ecfeb04c6
May 28 21:02:31.454002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.453967    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:02:31.454112 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.454031    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:02:31.454112 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:31.454061    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 28 21:02:32.109668 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:32.109610    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7" event={"ID":"e032542b-cc68-465e-b836-86bac06e1f5e","Type":"ContainerStarted","Data":"b8c88c3f497e73158391e2281eb2502eb460a5c2ff723ae1af4885e68ad0ef53"}
May 28 21:02:32.109668 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:32.109666    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7" event={"ID":"e032542b-cc68-465e-b836-86bac06e1f5e","Type":"ContainerStarted","Data":"b068a769c4858965c26f81a9dbaf4ee93efd6196c82a3223181a952ecfeb04c6"}
May 28 21:02:32.146248 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:32.146192    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7" podStartSLOduration=2.146173488 podStartE2EDuration="2.146173488s" podCreationTimestamp="2026-05-28 21:02:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 21:02:32.143977395 +0000 UTC m=+597.821680836" watchObservedRunningTime="2026-05-28 21:02:32.146173488 +0000 UTC m=+597.823876912"
May 28 21:02:32.315746 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:32.315717    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:32.320297 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:32.320274    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:33.113308 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:33.113284    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:33.114165 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:33.114146    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mhbh7"
May 28 21:02:34.815431 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:34.815363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:02:34.815816 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:34.815559    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:02:35.127724 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.127693    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:35.169974 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.169943    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:35.170126 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.170056    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.173339 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.173318    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 21:02:35.225444 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.225412    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:35.236124 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.236093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.236279 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.236187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdb4\" (UniqueName: \"kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.337721 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.337688    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdb4\" (UniqueName: \"kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.337909 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.337795    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.338385 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.338361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.350631 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.350600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdb4\" (UniqueName: \"kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4\") pod \"limitador-limitador-7d549b5b-s6d2k\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") " pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.480527 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.480442    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:35.547151 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.547125    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:02:35.549981 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.549961    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.556371 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.556349    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:02:35.584457 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.584427    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:02:35.618781 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.618736    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:35.622415 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:02:35.622386    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6753e1f_6d86_4a54_828f_af27a5c5bbe9.slice/crio-9e0e02b8daae6f2b67ae22157f47f4ddcfda6fca8fc1fdbe464a954a94d29f31 WatchSource:0}: Error finding container 9e0e02b8daae6f2b67ae22157f47f4ddcfda6fca8fc1fdbe464a954a94d29f31: Status 404 returned error can't find the container with id 9e0e02b8daae6f2b67ae22157f47f4ddcfda6fca8fc1fdbe464a954a94d29f31
May 28 21:02:35.640045 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.640020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnr8\" (UniqueName: \"kubernetes.io/projected/072cacc7-9b2d-44c8-952f-ccb9e8fef913-kube-api-access-hbnr8\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.640128 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.640061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/072cacc7-9b2d-44c8-952f-ccb9e8fef913-config-file\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.740798 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.740726    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnr8\" (UniqueName: \"kubernetes.io/projected/072cacc7-9b2d-44c8-952f-ccb9e8fef913-kube-api-access-hbnr8\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.740798 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.740790    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/072cacc7-9b2d-44c8-952f-ccb9e8fef913-config-file\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.741367 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.741348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/072cacc7-9b2d-44c8-952f-ccb9e8fef913-config-file\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.751433 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.751406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnr8\" (UniqueName: \"kubernetes.io/projected/072cacc7-9b2d-44c8-952f-ccb9e8fef913-kube-api-access-hbnr8\") pod \"limitador-limitador-78c99df468-dwwt6\" (UID: \"072cacc7-9b2d-44c8-952f-ccb9e8fef913\") " pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.862601 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.862564    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:35.993090 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:35.993066    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:02:35.994500 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:02:35.994463    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072cacc7_9b2d_44c8_952f_ccb9e8fef913.slice/crio-88637ce144d53dafa15fe954ee8b7bd6f50f655f4bad586b09a2b6607dd7516f WatchSource:0}: Error finding container 88637ce144d53dafa15fe954ee8b7bd6f50f655f4bad586b09a2b6607dd7516f: Status 404 returned error can't find the container with id 88637ce144d53dafa15fe954ee8b7bd6f50f655f4bad586b09a2b6607dd7516f
May 28 21:02:36.125962 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:36.125925    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6" event={"ID":"072cacc7-9b2d-44c8-952f-ccb9e8fef913","Type":"ContainerStarted","Data":"88637ce144d53dafa15fe954ee8b7bd6f50f655f4bad586b09a2b6607dd7516f"}
May 28 21:02:36.127156 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:36.127120    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" event={"ID":"b6753e1f-6d86-4a54-828f-af27a5c5bbe9","Type":"ContainerStarted","Data":"9e0e02b8daae6f2b67ae22157f47f4ddcfda6fca8fc1fdbe464a954a94d29f31"}
May 28 21:02:39.141883 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.141843    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" event={"ID":"b6753e1f-6d86-4a54-828f-af27a5c5bbe9","Type":"ContainerStarted","Data":"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"}
May 28 21:02:39.142347 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.142005    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:39.143246 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.143222    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6" event={"ID":"072cacc7-9b2d-44c8-952f-ccb9e8fef913","Type":"ContainerStarted","Data":"e820b591fd27e671019dec6538eb550c74e977dd83b64d52a9a5c1490bda75a2"}
May 28 21:02:39.143386 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.143371    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:39.164290 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.164250    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" podStartSLOduration=1.085328478 podStartE2EDuration="4.164238708s" podCreationTimestamp="2026-05-28 21:02:35 +0000 UTC" firstStartedPulling="2026-05-28 21:02:35.624945295 +0000 UTC m=+601.302648698" lastFinishedPulling="2026-05-28 21:02:38.703855524 +0000 UTC m=+604.381558928" observedRunningTime="2026-05-28 21:02:39.161946204 +0000 UTC m=+604.839649626" watchObservedRunningTime="2026-05-28 21:02:39.164238708 +0000 UTC m=+604.841942129"
May 28 21:02:39.182999 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:39.182954    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6" podStartSLOduration=1.470926385 podStartE2EDuration="4.182943066s" podCreationTimestamp="2026-05-28 21:02:35 +0000 UTC" firstStartedPulling="2026-05-28 21:02:35.996241395 +0000 UTC m=+601.673944795" lastFinishedPulling="2026-05-28 21:02:38.708258068 +0000 UTC m=+604.385961476" observedRunningTime="2026-05-28 21:02:39.180561652 +0000 UTC m=+604.858265072" watchObservedRunningTime="2026-05-28 21:02:39.182943066 +0000 UTC m=+604.860646487"
May 28 21:02:50.147586 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.147554    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:50.176230 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.147622    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-dwwt6"
May 28 21:02:50.217423 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.217387    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:50.217599 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.217563    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" podUID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" containerName="limitador" containerID="cri-o://ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af" gracePeriod=30
May 28 21:02:50.769952 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.769930    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:50.889157 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.889132    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkdb4\" (UniqueName: \"kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4\") pod \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") "
May 28 21:02:50.889321 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.889207    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file\") pod \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\" (UID: \"b6753e1f-6d86-4a54-828f-af27a5c5bbe9\") "
May 28 21:02:50.889564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.889534    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file" (OuterVolumeSpecName: "config-file") pod "b6753e1f-6d86-4a54-828f-af27a5c5bbe9" (UID: "b6753e1f-6d86-4a54-828f-af27a5c5bbe9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 21:02:50.891354 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.891332    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4" (OuterVolumeSpecName: "kube-api-access-lkdb4") pod "b6753e1f-6d86-4a54-828f-af27a5c5bbe9" (UID: "b6753e1f-6d86-4a54-828f-af27a5c5bbe9"). InnerVolumeSpecName "kube-api-access-lkdb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:02:50.989939 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.989915    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkdb4\" (UniqueName: \"kubernetes.io/projected/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-kube-api-access-lkdb4\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:50.989939 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:50.989940    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6753e1f-6d86-4a54-828f-af27a5c5bbe9-config-file\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:02:51.190770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.190668    2562 generic.go:358] "Generic (PLEG): container finished" podID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" containerID="ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af" exitCode=0
May 28 21:02:51.190770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.190712    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" event={"ID":"b6753e1f-6d86-4a54-828f-af27a5c5bbe9","Type":"ContainerDied","Data":"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"}
May 28 21:02:51.190770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.190733    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k" event={"ID":"b6753e1f-6d86-4a54-828f-af27a5c5bbe9","Type":"ContainerDied","Data":"9e0e02b8daae6f2b67ae22157f47f4ddcfda6fca8fc1fdbe464a954a94d29f31"}
May 28 21:02:51.190770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.190732    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-s6d2k"
May 28 21:02:51.190770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.190768    2562 scope.go:117] "RemoveContainer" containerID="ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"
May 28 21:02:51.199924 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.199906    2562 scope.go:117] "RemoveContainer" containerID="ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"
May 28 21:02:51.200177 ip-10-0-133-41 kubenswrapper[2562]: E0528 21:02:51.200158    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af\": container with ID starting with ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af not found: ID does not exist" containerID="ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"
May 28 21:02:51.200235 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.200186    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af"} err="failed to get container status \"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af\": rpc error: code = NotFound desc = could not find container \"ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af\": container with ID starting with ddf9ff8ea2316f959fc51eff24c15d13d8c80ec6cd1bbf0526b8de0c976af9af not found: ID does not exist"
May 28 21:02:51.207983 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.207963    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:51.213443 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.213422    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-s6d2k"]
May 28 21:02:51.236989 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.236967    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-q56vf"]
May 28 21:02:51.237448 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.237429    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" containerName="limitador"
May 28 21:02:51.237448 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.237448    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" containerName="limitador"
May 28 21:02:51.237591 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.237545    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" containerName="limitador"
May 28 21:02:51.242124 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.242108    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.245882 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.245860    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 28 21:02:51.246313 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.246295    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nb64p\""
May 28 21:02:51.250369 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.250330    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-q56vf"]
May 28 21:02:51.291740 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.291715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3f745ba-9c44-49a5-8cfd-217f569d9646-data\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.291854 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.291790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqsc\" (UniqueName: \"kubernetes.io/projected/c3f745ba-9c44-49a5-8cfd-217f569d9646-kube-api-access-5hqsc\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.392979 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.392949    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3f745ba-9c44-49a5-8cfd-217f569d9646-data\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.393135 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.393004    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqsc\" (UniqueName: \"kubernetes.io/projected/c3f745ba-9c44-49a5-8cfd-217f569d9646-kube-api-access-5hqsc\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.393330 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.393315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3f745ba-9c44-49a5-8cfd-217f569d9646-data\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.401908 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.401884    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqsc\" (UniqueName: \"kubernetes.io/projected/c3f745ba-9c44-49a5-8cfd-217f569d9646-kube-api-access-5hqsc\") pod \"postgres-68c4fbbd6f-q56vf\" (UID: \"c3f745ba-9c44-49a5-8cfd-217f569d9646\") " pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.556616 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.556529    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:51.686270 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:51.686238    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-q56vf"]
May 28 21:02:51.686733 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:02:51.686709    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f745ba_9c44_49a5_8cfd_217f569d9646.slice/crio-5bbc3d10b4f49665d3335937d419df657d7b65e941c549e0417ffb7ece40c5ad WatchSource:0}: Error finding container 5bbc3d10b4f49665d3335937d419df657d7b65e941c549e0417ffb7ece40c5ad: Status 404 returned error can't find the container with id 5bbc3d10b4f49665d3335937d419df657d7b65e941c549e0417ffb7ece40c5ad
May 28 21:02:52.196795 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:52.196694    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-q56vf" event={"ID":"c3f745ba-9c44-49a5-8cfd-217f569d9646","Type":"ContainerStarted","Data":"5bbc3d10b4f49665d3335937d419df657d7b65e941c549e0417ffb7ece40c5ad"}
May 28 21:02:52.920344 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:52.919988    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6753e1f-6d86-4a54-828f-af27a5c5bbe9" path="/var/lib/kubelet/pods/b6753e1f-6d86-4a54-828f-af27a5c5bbe9/volumes"
May 28 21:02:57.220966 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:57.220932    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-q56vf" event={"ID":"c3f745ba-9c44-49a5-8cfd-217f569d9646","Type":"ContainerStarted","Data":"9e9ad5fd0b8a3386fd7df45458c50159b514a15e9afdf78f6128ff6fa0f4df45"}
May 28 21:02:57.221394 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:57.221047    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:02:57.240238 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:02:57.240192    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-q56vf" podStartSLOduration=1.403286442 podStartE2EDuration="6.240179035s" podCreationTimestamp="2026-05-28 21:02:51 +0000 UTC" firstStartedPulling="2026-05-28 21:02:51.688098871 +0000 UTC m=+617.365802271" lastFinishedPulling="2026-05-28 21:02:56.524991462 +0000 UTC m=+622.202694864" observedRunningTime="2026-05-28 21:02:57.237544831 +0000 UTC m=+622.915248252" watchObservedRunningTime="2026-05-28 21:02:57.240179035 +0000 UTC m=+622.917882500"
May 28 21:03:03.254077 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:03.254049    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-q56vf"
May 28 21:03:04.697952 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.697919    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"]
May 28 21:03:04.700666 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.700652    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.703500 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.703479    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 21:03:04.703625 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.703509    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 21:03:04.704614 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.704598    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h4tg\""
May 28 21:03:04.709783 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.709762    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"]
May 28 21:03:04.810937 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.810907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.811089 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.811001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.811089 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.811054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntnw\" (UniqueName: \"kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.911912 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.911883    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.912036 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.911938    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntnw\" (UniqueName: \"kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.912036 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.912022    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.912354 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.912332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.912399 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.912375    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:04.920868 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:04.920846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntnw\" (UniqueName: \"kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:05.010842 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:05.010744    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:05.140995 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:05.140876    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"]
May 28 21:03:05.143461 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:03:05.143430    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e6dc4f_4f81_4f70_8515_425bbe63983a.slice/crio-f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411 WatchSource:0}: Error finding container f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411: Status 404 returned error can't find the container with id f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411
May 28 21:03:05.260923 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:05.260867    2562 generic.go:358] "Generic (PLEG): container finished" podID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerID="b17a0c868dc0a762d59b755daf3dee66be19547e5fcb0a47d4058ebf2f511b12" exitCode=0
May 28 21:03:05.260923 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:05.260911    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7" event={"ID":"88e6dc4f-4f81-4f70-8515-425bbe63983a","Type":"ContainerDied","Data":"b17a0c868dc0a762d59b755daf3dee66be19547e5fcb0a47d4058ebf2f511b12"}
May 28 21:03:05.261145 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:05.260933    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7" event={"ID":"88e6dc4f-4f81-4f70-8515-425bbe63983a","Type":"ContainerStarted","Data":"f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411"}
May 28 21:03:06.267017 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:06.266934    2562 generic.go:358] "Generic (PLEG): container finished" podID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerID="188adbbb6bfbfcce6613ab20d880d9f0ed28b601d27c7163835938bcbeb85098" exitCode=0
May 28 21:03:06.267017 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:06.266990    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7" event={"ID":"88e6dc4f-4f81-4f70-8515-425bbe63983a","Type":"ContainerDied","Data":"188adbbb6bfbfcce6613ab20d880d9f0ed28b601d27c7163835938bcbeb85098"}
May 28 21:03:07.272209 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:07.272160    2562 generic.go:358] "Generic (PLEG): container finished" podID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerID="1a02843b824177637395f43063b00b3d0a62aaa7ea4068c07a76872f7affeac0" exitCode=0
May 28 21:03:07.272568 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:07.272225    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7" event={"ID":"88e6dc4f-4f81-4f70-8515-425bbe63983a","Type":"ContainerDied","Data":"1a02843b824177637395f43063b00b3d0a62aaa7ea4068c07a76872f7affeac0"}
May 28 21:03:08.411524 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.411500    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:08.546435 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.546360    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util\") pod \"88e6dc4f-4f81-4f70-8515-425bbe63983a\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") "
May 28 21:03:08.546435 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.546434    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ntnw\" (UniqueName: \"kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw\") pod \"88e6dc4f-4f81-4f70-8515-425bbe63983a\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") "
May 28 21:03:08.546634 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.546472    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle\") pod \"88e6dc4f-4f81-4f70-8515-425bbe63983a\" (UID: \"88e6dc4f-4f81-4f70-8515-425bbe63983a\") "
May 28 21:03:08.547072 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.547039    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle" (OuterVolumeSpecName: "bundle") pod "88e6dc4f-4f81-4f70-8515-425bbe63983a" (UID: "88e6dc4f-4f81-4f70-8515-425bbe63983a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:03:08.548683 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.548653    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw" (OuterVolumeSpecName: "kube-api-access-6ntnw") pod "88e6dc4f-4f81-4f70-8515-425bbe63983a" (UID: "88e6dc4f-4f81-4f70-8515-425bbe63983a"). InnerVolumeSpecName "kube-api-access-6ntnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:03:08.551840 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.551822    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util" (OuterVolumeSpecName: "util") pod "88e6dc4f-4f81-4f70-8515-425bbe63983a" (UID: "88e6dc4f-4f81-4f70-8515-425bbe63983a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 21:03:08.648163 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.648129    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-bundle\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:03:08.648163 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.648154    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88e6dc4f-4f81-4f70-8515-425bbe63983a-util\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:03:08.648163 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:08.648163    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ntnw\" (UniqueName: \"kubernetes.io/projected/88e6dc4f-4f81-4f70-8515-425bbe63983a-kube-api-access-6ntnw\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:03:09.282237 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:09.282163    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7"
May 28 21:03:09.282237 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:09.282172    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70bjms7" event={"ID":"88e6dc4f-4f81-4f70-8515-425bbe63983a","Type":"ContainerDied","Data":"f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411"}
May 28 21:03:09.282237 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:09.282205    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f16561d452f9c71a367bfe64da2e128a07cdae001b0b65a63e2e261166461411"
May 28 21:03:11.988552 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988521    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cbbsr"]
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988901    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="util"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988913    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="util"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988940    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="pull"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988946    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="pull"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988955    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="extract"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.988960    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="extract"
May 28 21:03:11.989034 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.989032    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="88e6dc4f-4f81-4f70-8515-425bbe63983a" containerName="extract"
May 28 21:03:11.993963 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.993943    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr"
May 28 21:03:11.998148 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.998129    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 28 21:03:11.999284 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.999260    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-8csgw\""
May 28 21:03:11.999517 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:11.999325    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 28 21:03:12.006065 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.006036    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cbbsr"]
May 28 21:03:12.078885 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.078852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxj5\" (UniqueName: \"kubernetes.io/projected/d27a0d6b-441e-4088-93dd-db4b0579fc0a-kube-api-access-fmxj5\") pod \"keycloak-operator-7864d68cbd-cbbsr\" (UID: \"d27a0d6b-441e-4088-93dd-db4b0579fc0a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr"
May 28 21:03:12.180118 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.180090    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxj5\" (UniqueName: \"kubernetes.io/projected/d27a0d6b-441e-4088-93dd-db4b0579fc0a-kube-api-access-fmxj5\") pod \"keycloak-operator-7864d68cbd-cbbsr\" (UID: \"d27a0d6b-441e-4088-93dd-db4b0579fc0a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr"
May 28 21:03:12.188938 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.188913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxj5\" (UniqueName: \"kubernetes.io/projected/d27a0d6b-441e-4088-93dd-db4b0579fc0a-kube-api-access-fmxj5\") pod \"keycloak-operator-7864d68cbd-cbbsr\" (UID: \"d27a0d6b-441e-4088-93dd-db4b0579fc0a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr"
May 28 21:03:12.307015 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.306948    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr"
May 28 21:03:12.434256 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.434232    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cbbsr"]
May 28 21:03:12.436208 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:03:12.436183    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27a0d6b_441e_4088_93dd_db4b0579fc0a.slice/crio-439609432f725b9cd0f60bb300d930c0b81cdf03c906ac65d0599ec7901c2fe6 WatchSource:0}: Error finding container 439609432f725b9cd0f60bb300d930c0b81cdf03c906ac65d0599ec7901c2fe6: Status 404 returned error can't find the container with id 439609432f725b9cd0f60bb300d930c0b81cdf03c906ac65d0599ec7901c2fe6
May 28 21:03:12.437726 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:12.437708    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 21:03:13.299337 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:13.299303    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr" event={"ID":"d27a0d6b-441e-4088-93dd-db4b0579fc0a","Type":"ContainerStarted","Data":"439609432f725b9cd0f60bb300d930c0b81cdf03c906ac65d0599ec7901c2fe6"}
May 28 21:03:18.321217 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:18.321124    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr" event={"ID":"d27a0d6b-441e-4088-93dd-db4b0579fc0a","Type":"ContainerStarted","Data":"5c1e3ecbd7d22274155066752fa7ce6d4d76879a6580813dd95ae70e9307d44b"}
May 28 21:03:18.339112 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:03:18.339066    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-cbbsr" podStartSLOduration=1.792447894 podStartE2EDuration="7.339047731s" podCreationTimestamp="2026-05-28 21:03:11 +0000 UTC" firstStartedPulling="2026-05-28 21:03:12.437875162 +0000 UTC m=+638.115578561" lastFinishedPulling="2026-05-28 21:03:17.984474999 +0000 UTC m=+643.662178398" observedRunningTime="2026-05-28 21:03:18.337227229 +0000 UTC m=+644.014930651" watchObservedRunningTime="2026-05-28 21:03:18.339047731 +0000 UTC m=+644.016751151"
May 28 21:04:33.815442 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:04:33.815367    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:05:27.579271 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:05:27.579239    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:05:32.629298 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:05:32.629254    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:05:57.427243 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:05:57.427143    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:06:00.830157 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:06:00.830118    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:06:36.219720 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:06:36.219687    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:06:43.234840 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:06:43.234800    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:07:34.858113 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:07:34.858023    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:07:34.861349 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:07:34.861322    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:07:59.031344 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:07:59.031301    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:08:09.825160 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:08:09.825122    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:08:18.822454 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:08:18.822421    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:08:29.620939 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:08:29.620905    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:08:37.631429 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:08:37.631396    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:08:49.030785 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:08:49.030732    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:09:20.827982 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:09:20.827949    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:09:25.029982 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:09:25.029950    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:10:01.427299 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:10:01.427256    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:10:16.727364 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:10:16.727327    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:10:54.131148 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:10:54.131115    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:11:11.628518 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:11:11.628477    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:11:25.134022 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:11:25.133990    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:11:41.520711 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:11:41.520672    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:12:34.895543 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:12:34.895507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:12:34.909905 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:12:34.909881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:12:40.424803 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:12:40.424766    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:12:48.330147 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:12:48.330115    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:13:06.329844 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:13:06.329807    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:13:14.025149 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:13:14.025109    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:13:31.625986 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:13:31.625896    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:13:39.332415 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:13:39.332378    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:14:12.421499 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:14:12.421463    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:14:20.423184 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:14:20.423151    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:14:29.134931 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:14:29.134882    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:14:37.431206 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:14:37.431168    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:14:46.018454 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:14:46.018418    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:15:00.137808 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.137704    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666715-xgzc6"]
May 28 21:15:00.143115 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.143085    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:00.145678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.145655    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2ggv8\""
May 28 21:15:00.147950 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.147928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz9nz\" (UniqueName: \"kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz\") pod \"maas-api-key-cleanup-29666715-xgzc6\" (UID: \"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595\") " pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:00.152531 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.152508    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666715-xgzc6"]
May 28 21:15:00.248872 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.248844    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mz9nz\" (UniqueName: \"kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz\") pod \"maas-api-key-cleanup-29666715-xgzc6\" (UID: \"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595\") " pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:00.257117 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.257088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz9nz\" (UniqueName: \"kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz\") pod \"maas-api-key-cleanup-29666715-xgzc6\" (UID: \"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595\") " pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:00.454168 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.454081    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:00.588369 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.588347    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666715-xgzc6"]
May 28 21:15:00.590364 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:15:00.590336    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5384266_2d77_4d1a_a4a0_e8b0e8a6b595.slice/crio-d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0 WatchSource:0}: Error finding container d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0: Status 404 returned error can't find the container with id d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0
May 28 21:15:00.592114 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:00.592098    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 21:15:01.056564 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:01.056527    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6" event={"ID":"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595","Type":"ContainerStarted","Data":"d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0"}
May 28 21:15:03.530613 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:03.530583    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:15:06.084479 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:06.084441    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6" event={"ID":"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595","Type":"ContainerStarted","Data":"9c2e0d8732bbde20acae6fb82fdf604da330bcbc8c70a753539f2289cc1a2ac5"}
May 28 21:15:06.102339 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:06.102291    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6" podStartSLOduration=1.775715683 podStartE2EDuration="6.102277622s" podCreationTimestamp="2026-05-28 21:15:00 +0000 UTC" firstStartedPulling="2026-05-28 21:15:00.592230951 +0000 UTC m=+1346.269934349" lastFinishedPulling="2026-05-28 21:15:04.918792885 +0000 UTC m=+1350.596496288" observedRunningTime="2026-05-28 21:15:06.099252206 +0000 UTC m=+1351.776955627" watchObservedRunningTime="2026-05-28 21:15:06.102277622 +0000 UTC m=+1351.779981042"
May 28 21:15:07.095440 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:07.095399    2562 generic.go:358] "Generic (PLEG): container finished" podID="a5384266-2d77-4d1a-a4a0-e8b0e8a6b595" containerID="9c2e0d8732bbde20acae6fb82fdf604da330bcbc8c70a753539f2289cc1a2ac5" exitCode=0
May 28 21:15:07.095841 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:07.095452    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6" event={"ID":"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595","Type":"ContainerDied","Data":"9c2e0d8732bbde20acae6fb82fdf604da330bcbc8c70a753539f2289cc1a2ac5"}
May 28 21:15:08.226094 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:08.226068    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:08.336657 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:08.336623    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz9nz\" (UniqueName: \"kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz\") pod \"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595\" (UID: \"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595\") "
May 28 21:15:08.338925 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:08.338899    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz" (OuterVolumeSpecName: "kube-api-access-mz9nz") pod "a5384266-2d77-4d1a-a4a0-e8b0e8a6b595" (UID: "a5384266-2d77-4d1a-a4a0-e8b0e8a6b595"). InnerVolumeSpecName "kube-api-access-mz9nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:15:08.437454 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:08.437384    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz9nz\" (UniqueName: \"kubernetes.io/projected/a5384266-2d77-4d1a-a4a0-e8b0e8a6b595-kube-api-access-mz9nz\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:15:09.106529 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:09.106495    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6"
May 28 21:15:09.106688 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:09.106531    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666715-xgzc6" event={"ID":"a5384266-2d77-4d1a-a4a0-e8b0e8a6b595","Type":"ContainerDied","Data":"d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0"}
May 28 21:15:09.106688 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:09.106571    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d54551a9c5ce99cf203d6e7ca2eafb64c9e510ae41890f2f4e7d4735a5f312e0"
May 28 21:15:15.621136 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:15:15.621099    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:02.220537 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:02.220501    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:06.625942 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:06.625907    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:14.429119 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:14.429082    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:21.526106 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:21.526067    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:32.128036 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:32.127967    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:40.420302 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:40.420266    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:48.330543 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:48.330506    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:53.718575 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:53.718541    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:16:57.821131 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:16:57.821093    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:05.922801 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:05.922767    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:14.932597 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:14.932560    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:24.135620 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:24.135584    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:32.932526 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:32.932491    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:34.939358 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:34.939332    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:17:34.953974 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:34.953952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:17:40.828046 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:40.828007    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:49.036010 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:49.035975    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:17:59.229491 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:17:59.229412    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:18:06.535883 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:18:06.535848    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:18:16.033964 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:18:16.033926    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:18:24.532170 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:18:24.532137    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:20:41.429490 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:20:41.429452    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:20:46.527972 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:20:46.527937    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:12.928099 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:12.928057    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:19.732704 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:19.732662    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:27.933138 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:27.933090    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:39.328419 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:39.328382    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:47.631445 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:47.631408    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:21:58.626724 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:21:58.626690    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:07.035395 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:07.035358    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:17.128825 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:17.128786    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:26.734946 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:26.734861    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:34.976853 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:34.976824    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:22:34.990663 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:34.990643    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:22:37.439333 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:37.439294    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:45.428047 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:45.428014    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:22:51.124132 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:22:51.124100    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:23:19.029857 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:23:19.029821    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:01.234205 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:01.234124    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:09.929202 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:09.929166    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:19.428097 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:19.428063    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:27.726233 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:27.726194    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:35.725234 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:35.725188    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:49.328243 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:49.328206    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:24:57.027470 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:24:57.027433    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:04.023899 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:04.023865    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:09.531507 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:09.531472    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:13.724097 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:13.724060    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:22.623867 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:22.623783    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:30.725948 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:30.725909    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:41.320814 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:41.320777    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:25:58.933374 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:25:58.933339    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:06.726018 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:06.725980    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:15.925463 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:15.925429    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:24.528589 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:24.528548    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:41.531770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:41.531716    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:50.049162 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:50.049124    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:26:59.229449 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:26:59.229367    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:07.631690 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:07.631650    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:16.528953 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:16.528919    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:24.832198 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:24.832162    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:33.325225 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:33.325187    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:35.012656 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:35.012627    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:27:35.027831 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:35.027809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:27:47.019329 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:47.019295    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:27:55.619287 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:27:55.619249    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:08.822585 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:08.822546    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:18.029256 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:18.029214    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:26.324650 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:26.324572    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:34.527192 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:34.527155    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:42.428375 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:42.428341    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:28:58.519593 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:28:58.519560    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:29:07.123556 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:29:07.123521    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:29:16.224918 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:29:16.224885    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:29:24.624681 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:29:24.624651    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:29:47.916372 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:29:47.916335    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:30:00.136670 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.136590    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666730-25d28"]
May 28 21:30:00.137143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.136984    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5384266-2d77-4d1a-a4a0-e8b0e8a6b595" containerName="cleanup"
May 28 21:30:00.137143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.136995    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5384266-2d77-4d1a-a4a0-e8b0e8a6b595" containerName="cleanup"
May 28 21:30:00.137143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.137073    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5384266-2d77-4d1a-a4a0-e8b0e8a6b595" containerName="cleanup"
May 28 21:30:00.140147 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.140129    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:00.142621 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.142602    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2ggv8\""
May 28 21:30:00.152283 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.152264    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666730-25d28"]
May 28 21:30:00.193424 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.193398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhg49\" (UniqueName: \"kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49\") pod \"maas-api-key-cleanup-29666730-25d28\" (UID: \"4c84011a-9e23-487b-9c59-cf0530f76005\") " pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:00.293987 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.293963    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhg49\" (UniqueName: \"kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49\") pod \"maas-api-key-cleanup-29666730-25d28\" (UID: \"4c84011a-9e23-487b-9c59-cf0530f76005\") " pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:00.304086 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.304066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhg49\" (UniqueName: \"kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49\") pod \"maas-api-key-cleanup-29666730-25d28\" (UID: \"4c84011a-9e23-487b-9c59-cf0530f76005\") " pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:00.451138 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.451069    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:00.579418 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.579391    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666730-25d28"]
May 28 21:30:00.581694 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:30:00.581655    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c84011a_9e23_487b_9c59_cf0530f76005.slice/crio-4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926 WatchSource:0}: Error finding container 4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926: Status 404 returned error can't find the container with id 4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926
May 28 21:30:00.583894 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.583875    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 21:30:00.649107 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.649079    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666730-25d28" event={"ID":"4c84011a-9e23-487b-9c59-cf0530f76005","Type":"ContainerStarted","Data":"4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926"}
May 28 21:30:00.920006 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:00.919970    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dwwt6"]
May 28 21:30:01.654951 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:01.654911    2562 generic.go:358] "Generic (PLEG): container finished" podID="4c84011a-9e23-487b-9c59-cf0530f76005" containerID="58ea921aebe43cd55d8839ad2ed51831d62f697fe9c9a958685de492215461c0" exitCode=0
May 28 21:30:01.655348 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:01.655009    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666730-25d28" event={"ID":"4c84011a-9e23-487b-9c59-cf0530f76005","Type":"ContainerDied","Data":"58ea921aebe43cd55d8839ad2ed51831d62f697fe9c9a958685de492215461c0"}
May 28 21:30:02.798173 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:02.798145    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:02.918950 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:02.918862    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhg49\" (UniqueName: \"kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49\") pod \"4c84011a-9e23-487b-9c59-cf0530f76005\" (UID: \"4c84011a-9e23-487b-9c59-cf0530f76005\") "
May 28 21:30:02.921029 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:02.920999    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49" (OuterVolumeSpecName: "kube-api-access-nhg49") pod "4c84011a-9e23-487b-9c59-cf0530f76005" (UID: "4c84011a-9e23-487b-9c59-cf0530f76005"). InnerVolumeSpecName "kube-api-access-nhg49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 21:30:03.019820 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:03.019782    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhg49\" (UniqueName: \"kubernetes.io/projected/4c84011a-9e23-487b-9c59-cf0530f76005-kube-api-access-nhg49\") on node \"ip-10-0-133-41.ec2.internal\" DevicePath \"\""
May 28 21:30:03.665397 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:03.665367    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666730-25d28" event={"ID":"4c84011a-9e23-487b-9c59-cf0530f76005","Type":"ContainerDied","Data":"4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926"}
May 28 21:30:03.665397 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:03.665398    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4303aba7bb80e0af9f967b9cca9387b4c2855a20168adbee86de4120cfeb6926"
May 28 21:30:03.665618 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:03.665417    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666730-25d28"
May 28 21:30:11.258441 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:11.258407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666715-xgzc6_a5384266-2d77-4d1a-a4a0-e8b0e8a6b595/cleanup/0.log"
May 28 21:30:11.366243 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:11.366220    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666730-25d28_4c84011a-9e23-487b-9c59-cf0530f76005/cleanup/0.log"
May 28 21:30:11.946716 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:11.946688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5_71a2fbbc-9b23-4cb7-a0bf-861784f94bce/manager/0.log"
May 28 21:30:12.054710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.054688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-q56vf_c3f745ba-9c44-49a5-8cfd-217f569d9646/postgres/0.log"
May 28 21:30:12.807678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.807640    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/util/0.log"
May 28 21:30:12.813092 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.813066    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/pull/0.log"
May 28 21:30:12.818125 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.818106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/extract/0.log"
May 28 21:30:12.923903 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.923881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/util/0.log"
May 28 21:30:12.930099 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.930079    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/pull/0.log"
May 28 21:30:12.935714 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:12.935696    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/extract/0.log"
May 28 21:30:13.059056 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.058991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/util/0.log"
May 28 21:30:13.064293 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.064267    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/pull/0.log"
May 28 21:30:13.069416 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.069399    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/extract/0.log"
May 28 21:30:13.184484 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.184456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/util/0.log"
May 28 21:30:13.190101 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.190075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/pull/0.log"
May 28 21:30:13.195919 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.195893    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/extract/0.log"
May 28 21:30:13.537988 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.537959    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vm4gw_b1a2da43-6d8d-4f02-83ce-9ecff0466a2b/manager/0.log"
May 28 21:30:13.649639 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.649616    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-jvsgc_a97e3997-03a6-4dac-9b1c-6c970662c2c3/kuadrant-console-plugin/0.log"
May 28 21:30:13.763275 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.763250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ljcvz_fb398409-5d84-4ca1-bfbd-dbd1240a0284/registry-server/0.log"
May 28 21:30:13.983634 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:13.983608    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-dwwt6_072cacc7-9b2d-44c8-952f-ccb9e8fef913/limitador/0.log"
May 28 21:30:14.419475 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:14.419443    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blbx7b_68c3f9d9-e389-413a-bc82-f71fb6f583cc/istio-proxy/0.log"
May 28 21:30:14.857463 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:14.857436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mhbh7_e032542b-cc68-465e-b836-86bac06e1f5e/istio-proxy/0.log"
May 28 21:30:19.683898 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.683862    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hjxh6/must-gather-sbgxh"]
May 28 21:30:19.684274 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.684244    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c84011a-9e23-487b-9c59-cf0530f76005" containerName="cleanup"
May 28 21:30:19.684274 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.684255    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c84011a-9e23-487b-9c59-cf0530f76005" containerName="cleanup"
May 28 21:30:19.684351 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.684318    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c84011a-9e23-487b-9c59-cf0530f76005" containerName="cleanup"
May 28 21:30:19.687741 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.687724    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.690475 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.690453    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hjxh6\"/\"kube-root-ca.crt\""
May 28 21:30:19.691693 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.691676    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hjxh6\"/\"openshift-service-ca.crt\""
May 28 21:30:19.691789 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.691718    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hjxh6\"/\"default-dockercfg-dbw98\""
May 28 21:30:19.700820 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.697790    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjxh6/must-gather-sbgxh"]
May 28 21:30:19.865352 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.865318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec5185d9-18bb-4019-9eba-0fda9e3ff099-must-gather-output\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.865352 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.865358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxvd\" (UniqueName: \"kubernetes.io/projected/ec5185d9-18bb-4019-9eba-0fda9e3ff099-kube-api-access-mtxvd\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.966173 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.966084    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec5185d9-18bb-4019-9eba-0fda9e3ff099-must-gather-output\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.966173 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.966135    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxvd\" (UniqueName: \"kubernetes.io/projected/ec5185d9-18bb-4019-9eba-0fda9e3ff099-kube-api-access-mtxvd\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.966408 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.966388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec5185d9-18bb-4019-9eba-0fda9e3ff099-must-gather-output\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:19.973847 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:19.973822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxvd\" (UniqueName: \"kubernetes.io/projected/ec5185d9-18bb-4019-9eba-0fda9e3ff099-kube-api-access-mtxvd\") pod \"must-gather-sbgxh\" (UID: \"ec5185d9-18bb-4019-9eba-0fda9e3ff099\") " pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:20.003845 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:20.003823    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjxh6/must-gather-sbgxh"
May 28 21:30:20.134977 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:20.134952    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjxh6/must-gather-sbgxh"]
May 28 21:30:20.136808 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:30:20.136780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec5185d9_18bb_4019_9eba_0fda9e3ff099.slice/crio-3bdb5d4a9ab297a7183f369318a7f026dd59d8b8cdaf0c60711e22e94b37f33e WatchSource:0}: Error finding container 3bdb5d4a9ab297a7183f369318a7f026dd59d8b8cdaf0c60711e22e94b37f33e: Status 404 returned error can't find the container with id 3bdb5d4a9ab297a7183f369318a7f026dd59d8b8cdaf0c60711e22e94b37f33e
May 28 21:30:20.737678 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:20.737641    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjxh6/must-gather-sbgxh" event={"ID":"ec5185d9-18bb-4019-9eba-0fda9e3ff099","Type":"ContainerStarted","Data":"3bdb5d4a9ab297a7183f369318a7f026dd59d8b8cdaf0c60711e22e94b37f33e"}
May 28 21:30:21.743394 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:21.743358    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjxh6/must-gather-sbgxh" event={"ID":"ec5185d9-18bb-4019-9eba-0fda9e3ff099","Type":"ContainerStarted","Data":"9c25efa1e3a4e91c6b607efce38a4b1d0b080dd2ac2b9ea054f3a4e90969d580"}
May 28 21:30:21.743394 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:21.743401    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjxh6/must-gather-sbgxh" event={"ID":"ec5185d9-18bb-4019-9eba-0fda9e3ff099","Type":"ContainerStarted","Data":"7d8a684a3288b23067031c548d96e60d310e93b72deccc5a4ecabb6ff7878732"}
May 28 21:30:21.760464 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:21.760404    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hjxh6/must-gather-sbgxh" podStartSLOduration=1.9635614160000001 podStartE2EDuration="2.760388968s" podCreationTimestamp="2026-05-28 21:30:19 +0000 UTC" firstStartedPulling="2026-05-28 21:30:20.138947164 +0000 UTC m=+2265.816650567" lastFinishedPulling="2026-05-28 21:30:20.935774715 +0000 UTC m=+2266.613478119" observedRunningTime="2026-05-28 21:30:21.756803378 +0000 UTC m=+2267.434506799" watchObservedRunningTime="2026-05-28 21:30:21.760388968 +0000 UTC m=+2267.438092571"
May 28 21:30:22.453279 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:22.453245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8tfgc_c3efa99c-a4e0-4eee-9413-27ab5e34f301/global-pull-secret-syncer/0.log"
May 28 21:30:22.626577 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:22.626540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnbhx_69886b82-0194-4826-96bf-de6716248fae/konnectivity-agent/0.log"
May 28 21:30:22.648788 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:22.648734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-41.ec2.internal_29a359176032bf9805509c9b89251c4f/haproxy/0.log"
May 28 21:30:26.344677 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.344647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/extract/0.log"
May 28 21:30:26.372192 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.372170    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/util/0.log"
May 28 21:30:26.396140 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.396116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x5rc6_a140d23f-0871-40f5-a87d-065b200ba0b3/pull/0.log"
May 28 21:30:26.425419 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.425393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/extract/0.log"
May 28 21:30:26.446194 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.446163    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/util/0.log"
May 28 21:30:26.469129 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.469100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05nlds_5a10622b-8061-48c0-afd7-8cac0d5bb3e9/pull/0.log"
May 28 21:30:26.499870 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.499839    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/extract/0.log"
May 28 21:30:26.520990 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.520941    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/util/0.log"
May 28 21:30:26.543160 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.543134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghc58_9c71f884-6909-4660-a49d-fb40e9efb9ca/pull/0.log"
May 28 21:30:26.572120 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.571917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/extract/0.log"
May 28 21:30:26.599707 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.599637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/util/0.log"
May 28 21:30:26.626114 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.626088    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tkstf_da434caa-b887-4603-ba4c-50a08d275d76/pull/0.log"
May 28 21:30:26.892834 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.892736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-vm4gw_b1a2da43-6d8d-4f02-83ce-9ecff0466a2b/manager/0.log"
May 28 21:30:26.918168 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.918140    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-jvsgc_a97e3997-03a6-4dac-9b1c-6c970662c2c3/kuadrant-console-plugin/0.log"
May 28 21:30:26.957213 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:26.957181    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ljcvz_fb398409-5d84-4ca1-bfbd-dbd1240a0284/registry-server/0.log"
May 28 21:30:27.040326 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:27.040286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-dwwt6_072cacc7-9b2d-44c8-952f-ccb9e8fef913/limitador/0.log"
May 28 21:30:28.415321 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.415292    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-lw5fb_656e4bcb-2c8b-4200-b0cc-49c5aee32699/cluster-monitoring-operator/0.log"
May 28 21:30:28.449261 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.449234    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8x9jm_80d8df27-47fb-4935-bcf6-ad6e8e51c986/kube-state-metrics/0.log"
May 28 21:30:28.468458 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.468435    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8x9jm_80d8df27-47fb-4935-bcf6-ad6e8e51c986/kube-rbac-proxy-main/0.log"
May 28 21:30:28.493531 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.493496    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8x9jm_80d8df27-47fb-4935-bcf6-ad6e8e51c986/kube-rbac-proxy-self/0.log"
May 28 21:30:28.528306 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.528281    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d475698f5-rh2sw_80ba73d1-157f-42ee-97b6-828275e2f92e/metrics-server/0.log"
May 28 21:30:28.605627 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.605596    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q6wl_e856df1b-d02a-4bf5-a081-d840870c87a5/node-exporter/0.log"
May 28 21:30:28.630486 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.630462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q6wl_e856df1b-d02a-4bf5-a081-d840870c87a5/kube-rbac-proxy/0.log"
May 28 21:30:28.662938 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.662911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q6wl_e856df1b-d02a-4bf5-a081-d840870c87a5/init-textfile/0.log"
May 28 21:30:28.880321 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.880291    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vc8pb_d3caa507-a541-48ed-ab50-362c1a100c04/kube-rbac-proxy-main/0.log"
May 28 21:30:28.908802 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.908742    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vc8pb_d3caa507-a541-48ed-ab50-362c1a100c04/kube-rbac-proxy-self/0.log"
May 28 21:30:28.935554 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:28.935517    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vc8pb_d3caa507-a541-48ed-ab50-362c1a100c04/openshift-state-metrics/0.log"
May 28 21:30:29.245731 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.245639    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d4997-pcc24_fd10bc6a-2bf7-48b4-87bd-80fccc174cdb/telemeter-client/0.log"
May 28 21:30:29.269143 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.269110    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d4997-pcc24_fd10bc6a-2bf7-48b4-87bd-80fccc174cdb/reload/0.log"
May 28 21:30:29.292714 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.292651    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d4997-pcc24_fd10bc6a-2bf7-48b4-87bd-80fccc174cdb/kube-rbac-proxy/0.log"
May 28 21:30:29.323416 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.323375    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/thanos-query/0.log"
May 28 21:30:29.345509 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.345456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/kube-rbac-proxy-web/0.log"
May 28 21:30:29.369240 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.369190    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/kube-rbac-proxy/0.log"
May 28 21:30:29.392388 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.392364    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/prom-label-proxy/0.log"
May 28 21:30:29.414000 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.413971    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/kube-rbac-proxy-rules/0.log"
May 28 21:30:29.441137 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:29.441086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7649d8c475-bk5tf_db11bdf0-b4ac-4b7c-a930-7f78b4898c44/kube-rbac-proxy-metrics/0.log"
May 28 21:30:30.589798 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:30.589744    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-56bmz_be31af03-732b-4ed0-822b-fee69fce22b0/networking-console-plugin/0.log"
May 28 21:30:31.076368 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.076297    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"]
May 28 21:30:31.080904 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.080877    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.090847 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.090820    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"]
May 28 21:30:31.131770 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.131730    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/2.log"
May 28 21:30:31.137705 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.137677    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-t28r6_591a44ff-c166-40aa-bdfb-1f8b444dd0b1/console-operator/3.log"
May 28 21:30:31.190002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.189601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-lib-modules\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.190002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.189657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-podres\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.190002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.189691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wvb\" (UniqueName: \"kubernetes.io/projected/e44c37df-46ec-4303-9321-c39645c36416-kube-api-access-f9wvb\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.190002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.189808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-sys\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.190002 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.189863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-proc\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.290716 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290677    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-proc\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.290930 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290797    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-lib-modules\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.290930 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290833    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-podres\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.290930 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290831    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-proc\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.290930 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wvb\" (UniqueName: \"kubernetes.io/projected/e44c37df-46ec-4303-9321-c39645c36416-kube-api-access-f9wvb\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.291193 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-podres\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.291193 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.290993    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-lib-modules\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.291193 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.291007    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-sys\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.291193 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.291063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44c37df-46ec-4303-9321-c39645c36416-sys\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.298596 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.298573    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wvb\" (UniqueName: \"kubernetes.io/projected/e44c37df-46ec-4303-9321-c39645c36416-kube-api-access-f9wvb\") pod \"perf-node-gather-daemonset-qsmmd\" (UID: \"e44c37df-46ec-4303-9321-c39645c36416\") " pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.401346 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.401294    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.578652 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.577085    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"]
May 28 21:30:31.580529 ip-10-0-133-41 kubenswrapper[2562]: W0528 21:30:31.580503    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode44c37df_46ec_4303_9321_c39645c36416.slice/crio-bd89ec19a043d9492b4444006a3f80b788f78c9b4a3e9e79f5e4fe384ccfffee WatchSource:0}: Error finding container bd89ec19a043d9492b4444006a3f80b788f78c9b4a3e9e79f5e4fe384ccfffee: Status 404 returned error can't find the container with id bd89ec19a043d9492b4444006a3f80b788f78c9b4a3e9e79f5e4fe384ccfffee
May 28 21:30:31.686250 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.686210    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9c6d6f6dd-zn87b_1afd30ac-69b8-4385-b60a-007e6ad1bff2/console/0.log"
May 28 21:30:31.826540 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.826130    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd" event={"ID":"e44c37df-46ec-4303-9321-c39645c36416","Type":"ContainerStarted","Data":"fe4a1e959da0207951b1a6f5c1c1852cd766e3d56d90ead9c2949222a3a46ffa"}
May 28 21:30:31.826540 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.826177    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd" event={"ID":"e44c37df-46ec-4303-9321-c39645c36416","Type":"ContainerStarted","Data":"bd89ec19a043d9492b4444006a3f80b788f78c9b4a3e9e79f5e4fe384ccfffee"}
May 28 21:30:31.826540 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.826223    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:31.847054 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:31.846999    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd" podStartSLOduration=0.84698079 podStartE2EDuration="846.98079ms" podCreationTimestamp="2026-05-28 21:30:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 21:30:31.843966711 +0000 UTC m=+2277.521670132" watchObservedRunningTime="2026-05-28 21:30:31.84698079 +0000 UTC m=+2277.524684213"
May 28 21:30:33.080863 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:33.080833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-924m8_5a74cd70-3edc-45cb-8883-cebba1e226a4/dns/0.log"
May 28 21:30:33.105150 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:33.105126    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-924m8_5a74cd70-3edc-45cb-8883-cebba1e226a4/kube-rbac-proxy/0.log"
May 28 21:30:33.216279 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:33.216248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhsfv_9ed0f3f9-378d-4538-88f1-d1e4af2a8941/dns-node-resolver/0.log"
May 28 21:30:33.669109 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:33.669080    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8976b64d5-xm7jc_d35503e7-0393-4558-a6c5-22cb254c116a/registry/0.log"
May 28 21:30:33.689603 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:33.689582    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7fd75_8fea290a-5707-444e-a232-01472e06f610/node-ca/0.log"
May 28 21:30:34.604549 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:34.604522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blbx7b_68c3f9d9-e389-413a-bc82-f71fb6f583cc/istio-proxy/0.log"
May 28 21:30:34.813310 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:34.813280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mhbh7_e032542b-cc68-465e-b836-86bac06e1f5e/istio-proxy/0.log"
May 28 21:30:35.431739 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:35.431712    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v5vst_cd1ae37a-66c4-4ae8-9bed-4b33783a50b2/serve-healthcheck-canary/0.log"
May 28 21:30:35.902853 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:35.902826    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-fbw9p_1169c1ed-2cd3-4627-b491-a282b93c71b7/insights-operator/0.log"
May 28 21:30:35.904162 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:35.904137    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-fbw9p_1169c1ed-2cd3-4627-b491-a282b93c71b7/insights-operator/1.log"
May 28 21:30:36.059741 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:36.059714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sns5f_5aaba363-200d-4eb2-bc6f-b955a1fca940/kube-rbac-proxy/0.log"
May 28 21:30:36.079875 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:36.079838    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sns5f_5aaba363-200d-4eb2-bc6f-b955a1fca940/exporter/0.log"
May 28 21:30:36.100580 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:36.100538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sns5f_5aaba363-200d-4eb2-bc6f-b955a1fca940/extractor/0.log"
May 28 21:30:37.840902 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:37.840875    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hjxh6/perf-node-gather-daemonset-qsmmd"
May 28 21:30:37.968867 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:37.968829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666715-xgzc6_a5384266-2d77-4d1a-a4a0-e8b0e8a6b595/cleanup/0.log"
May 28 21:30:37.991264 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:37.991239    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666730-25d28_4c84011a-9e23-487b-9c59-cf0530f76005/cleanup/0.log"
May 28 21:30:38.180085 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:38.180011    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc97fc4b4-xf8z5_71a2fbbc-9b23-4cb7-a0bf-861784f94bce/manager/0.log"
May 28 21:30:38.202710 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:38.202683    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-q56vf_c3f745ba-9c44-49a5-8cfd-217f569d9646/postgres/0.log"
May 28 21:30:39.402714 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:39.402649    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8459dbdd59-97qmg_86e7519a-e888-4eb2-a1f1-812d69044442/manager/0.log"
May 28 21:30:45.515695 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.515664    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/kube-multus-additional-cni-plugins/0.log"
May 28 21:30:45.536378 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.536354    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/egress-router-binary-copy/0.log"
May 28 21:30:45.558009 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.557986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/cni-plugins/0.log"
May 28 21:30:45.579280 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.579254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/bond-cni-plugin/0.log"
May 28 21:30:45.599366 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.599346    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/routeoverride-cni/0.log"
May 28 21:30:45.619597 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.619579    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/whereabouts-cni-bincopy/0.log"
May 28 21:30:45.639998 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.639974    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2qpq_4fe38dc0-8991-4100-b32b-2f4201cce82e/whereabouts-cni/0.log"
May 28 21:30:45.700693 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.700669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gbx42_0307ea36-bee5-419b-81c5-743d31a91b53/kube-multus/0.log"
May 28 21:30:45.745637 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.745613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j7n5k_f8610169-a367-44ba-9b7f-4be7849bdee6/network-metrics-daemon/0.log"
May 28 21:30:45.765826 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:45.765765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j7n5k_f8610169-a367-44ba-9b7f-4be7849bdee6/kube-rbac-proxy/0.log"
May 28 21:30:46.962406 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:46.962373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/ovn-controller/0.log"
May 28 21:30:46.989862 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:46.989839    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/ovn-acl-logging/0.log"
May 28 21:30:47.008066 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.008041    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/kube-rbac-proxy-node/0.log"
May 28 21:30:47.029796 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.029767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/kube-rbac-proxy-ovn-metrics/0.log"
May 28 21:30:47.052581 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.052554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/northd/0.log"
May 28 21:30:47.073413 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.073394    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/nbdb/0.log"
May 28 21:30:47.093184 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.093168    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/sbdb/0.log"
May 28 21:30:47.212126 ip-10-0-133-41 kubenswrapper[2562]: I0528 21:30:47.212101    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kq6z5_faa33052-e358-4a91-b3a3-391fd3a4fda0/ovnkube-controller/0.log"